Jul 19 17:29:14 devstack cinder-volume[76614]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 19 17:29:14 devstack cinder-volume[76614]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 19 17:29:14 devstack cinder-volume[76614]: we strongly recommend against using it for new projects. Jul 19 17:29:14 devstack cinder-volume[76614]: If you are already using Eventlet, we recommend migrating to a different Jul 19 17:29:14 devstack cinder-volume[76614]: framework. For more detail see Jul 19 17:29:14 devstack cinder-volume[76614]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 19 17:29:14 devstack cinder-volume[76614]: import eventlet # noqa Jul 19 17:29:17 devstack cinder-volume[76614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 19 17:29:17 devstack cinder-volume[76614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 19 17:29:17 devstack cinder-volume[76614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 19 17:29:18 devstack cinder-volume[76614]: INFO dbcounter [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Registered counter for database cinder Jul 19 17:29:18 devstack cinder-volume[76614]: DEBUG oslo_db.sqlalchemy.engines [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76614) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 17:29:18 devstack cinder-volume[76614]: DEBUG dbcounter [-] [76614] Writer thread running {{(pid=76614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 19 17:29:18 devstack cinder-volume[76614]: INFO cinder.rpc [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 19 17:29:18 devstack cinder-volume[76614]: INFO cinder.rpc [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 19 17:29:18 devstack cinder-volume[76614]: DEBUG oslo_db.sqlalchemy.engines [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76614) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 17:29:18 devstack cinder-volume[76614]: INFO cinder.volume.manager [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Determined volume DB was empty at startup. Jul 19 17:29:18 devstack cinder-volume[76614]: DEBUG cinder.volume.manager [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76614) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 19 17:29:18 devstack cinder-volume[76614]: INFO cinder.volume.manager [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 19 17:29:18 devstack cinder-volume[76614]: WARNING stevedore.named [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 19 17:29:18 devstack cinder-volume[76614]: WARNING castellan.key_manager [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 19 17:29:18 devstack cinder-volume[76614]: WARNING cinder.keymgr.conf_key_mgr [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 19 17:29:18 devstack cinder-volume[76614]: DEBUG cinder.volume.drivers.lvm [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76614) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 19 17:29:18 devstack cinder-volume[76614]: DEBUG oslo_concurrency.processutils [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_concurrency.processutils [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] CMD "cinder-rtstool verify" returned: 0 in 0.430s {{(pid=76614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_db.sqlalchemy.engines [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76614) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 17:29:19 devstack cinder-volume[76614]: INFO cinder.rpc [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 19 17:29:19 devstack cinder-volume[76614]: INFO cinder.rpc [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 19 17:29:19 devstack cinder-volume[76614]: WARNING stevedore.named [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 19 17:29:19 devstack cinder-volume[76614]: WARNING castellan.key_manager [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 19 17:29:19 devstack cinder-volume[76614]: INFO cinder.volume.manager [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_db.sqlalchemy.engines [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76614) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 17:29:19 devstack cinder-volume[76614]: INFO oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Starting 1 workers Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Started child 76765 {{(pid=76614) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Full set of CONF: {{(pid=76614) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] ******************************************************************************** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Configuration options gathered from: {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] ================================================================================ {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] allow_availability_zone_fallback = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] allow_compression_on_image_upload = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] allowed_direct_url_schemes = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76765]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] api_rate_limit = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] auth_strategy = keystone {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] az_cache_duration = 3600 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_availability_zone = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_host = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_stats_polling_interval = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backup_api_class = cinder.backup.api.API {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backup_name_template = backup-%s {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backup_use_same_host = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backup_use_temp_snapshot = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] chap_password = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] chap_username = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cinder_internal_tenant_project_id = 793ac77d183649a9bda71921df909e2e {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cinder_internal_tenant_user_id = 0aa9c03d807446d89ca5c1c4bc38469a {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cloned_volume_same_az = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cluster = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] compression_format = gzip {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] compute_api_class = cinder.compute.nova.API {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] config_dir = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] config_source = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] control_exchange = openstack {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] debug = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] default_availability_zone = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] default_group_type = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] default_volume_type = lvmdriver-1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] disk_geometry = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] driver_client_cert = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] driver_client_cert_key = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] driver_data_namespace = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] driver_ssl_cert_path = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] driver_ssl_cert_verify = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] driver_use_ssl = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] enable_force_upload = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] enable_new_services = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] enable_unsupported_driver = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] enabled_backends = ['lvmdriver-1'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] enforce_multipath_for_image_xfer = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] filter_function = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance_api_insecure = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance_api_servers = ['http://192.168.122.228/image'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance_api_ssl_compression = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance_ca_certificates_file = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance_catalog_info = image:glance:publicURL {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance_certfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance_keyfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance_num_retries = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance_request_timeout = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] goodness_function = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] graceful_shutdown_timeout = 5 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] group_api_class = cinder.group.api.API {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] host = devstack {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] image_compress_on_upload = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] image_conversion_address_space_limit = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] image_conversion_cpu_limit = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] image_conversion_disable = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] image_upload_use_cinder_backend = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] image_upload_use_internal_tenant = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] image_volume_cache_enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] image_volume_cache_max_count = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] image_volume_cache_max_size_gb = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] init_host_max_objects_retrieval = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] instance_format = [instance: %(uuid)s] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] iscsi_target_flags = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] iscsi_write_cache = on {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] iser_helper = tgtadm {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] iser_ip_address = 192.168.122.228 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] iser_port = 3260 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] log_color = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] log_config_append = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] log_dir = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] log_file = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] log_options = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] log_rotate_interval = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] log_rotate_interval_type = days {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] log_rotation_type = none {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] max_age = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] max_logfile_count = 30 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] max_logfile_size_mb = 200 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] max_over_subscription_ratio = 20.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] message_reap_interval = 86400 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] message_ttl = 2592000 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] migration_create_volume_timeout_secs = 300 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] monkey_patch = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] monkey_patch_modules = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] my_ip = 192.168.122.228 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] no_snapshot_gb_quota = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] num_iser_scan_tries = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] num_shell_tries = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] num_volume_device_scan_tries = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] nvmeof_conn_info_version = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] nvmet_ns_id = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] nvmet_port_id = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] osapi_max_limit = 1000 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] osapi_volume_ext_list = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] osapi_volume_listen = 0.0.0.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] osapi_volume_listen_port = 8776 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] osapi_volume_use_ssl = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] osapi_volume_workers = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] per_volume_size_limit = -1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] periodic_fuzzy_delay = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] periodic_interval = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] project_id_regex = [0-9a-f\-]+ {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] public_endpoint = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] publish_errors = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] quota_backup_gigabytes = 1000 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] quota_backups = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] quota_gigabytes = 1000 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] quota_groups = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] quota_snapshots = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76765]: INFO cinder.volume.manager [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] quota_volumes = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] rate_limit_burst = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] rate_limit_except_level = CRITICAL {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] rate_limit_interval = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] reinit_driver_count = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] replication_device = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] report_discard_supported = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] report_interval = 120 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] reservation_clean_interval = 86400 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] reservation_expire = 86400 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] reserved_image_namespaces = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] reserved_percentage = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] rpc_response_timeout = 120 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] run_external_periodic_tasks = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] scst_target_driver = iscsi {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] scst_target_iqn_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] service_down_time = 720 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] shell_completion = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] snapshot_name_template = snapshot-%s {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] snapshot_same_host = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] split_loggers = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] state_path = /opt/stack/data/cinder {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] storage_availability_zone = nova {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] storage_protocol = iSCSI {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] syslog_log_facility = LOG_USER {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] target_helper = lioadm {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] target_ip_address = 192.168.122.228 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] target_port = 3260 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] target_protocol = iscsi {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] target_secondary_ip_addresses = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] trace_flags = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] transfer_api_class = cinder.transfer.api.API {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] transport_url = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] until_refresh = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] use_chap_auth = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] use_default_quota_class = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] use_journal = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] use_json = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] use_multipath_for_image_xfer = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] use_stderr = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] use_syslog = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] verify_glance_signatures = enabled {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] volume_api_class = cinder.volume.api.API {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] volume_backend_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] volume_clear = zero {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] volume_clear_ionice = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] volume_clear_size = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] volume_copy_bps_limit = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] volume_dd_blocksize = 1M {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] volume_name_template = volume-%s {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] volume_service_inithost_offload = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] volume_usage_audit_period = month {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] zoning_mode = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_concurrency.disable_process_locking = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.auth_section = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.auth_type = password {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.auth_version = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.cache = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.certfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.delay_auth_decision = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.http_connect_timeout = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.include_service_catalog = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.insecure = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.interface = public {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.keyfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcache_password = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcache_username = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.region_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.service_token_roles_required = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.service_type = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.token_cache_time = 300 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.228/identity {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.backend = dogpile.cache.null {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.backend_argument = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.backend_expiration_time = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.config_prefix = cache.oslo {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.debug_cache_backend = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.enable_retry_client = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.enable_socket_keepalive = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.expiration_time = 600 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.hashclient_retry_attempts = 2 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.memcache_dead_retry = 300 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.memcache_pool_maxsize = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.memcache_sasl_enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.password = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.proxies = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.redis_db = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.redis_sentinel_service_name = mymaster {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.redis_server = localhost:6379 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.retry_attempts = 2 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.retry_delay = 0.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.socket_keepalive_count = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.socket_keepalive_idle = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.socket_keepalive_interval = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.socket_timeout = 1.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.tls_allowed_ciphers = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.tls_cafile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.tls_certfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.tls_enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.tls_keyfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cache.username = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] coordination.backend_url = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.asyncio_connection = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.asyncio_slave_connection = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.backend = sqlalchemy {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.connection = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.connection_debug = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.connection_parameters = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.connection_recycle_time = 3600 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.connection_trace = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.db_inc_retry_interval = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.db_max_retries = 20 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.db_max_retry_interval = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.db_retry_interval = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.max_overflow = 50 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.max_pool_size = 5 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.max_retries = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.mysql_wsrep_sync_wait = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.pool_timeout = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.retry_interval = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.slave_connection = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.sqlite_synchronous = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.synchronous_reader = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] database.use_db_reconnect = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] profiler.connection_string = messaging:// {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] profiler.enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] profiler.es_doc_type = notification {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] profiler.es_scroll_size = 10000 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] profiler.es_scroll_time = 2m {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] profiler.filter_error_trace = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] profiler.hmac_keys = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] profiler.sentinel_service_name = mymaster {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] profiler.socket_timeout = 0.1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] profiler.trace_requests = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] profiler.trace_sqlalchemy = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] profiler_jaeger.process_tags = {} {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] profiler_jaeger.service_name_prefix = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] profiler_otlp.service_name_prefix = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_policy.enforce_new_defaults = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_policy.policy_default_rule = default {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_policy.policy_file = policy.yaml {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_policy.remote_timeout = 60.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] privsep_osbrick.group = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] privsep_osbrick.helper_command = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] privsep_osbrick.user = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cinder_sys_admin.group = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cinder_sys_admin.helper_command = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] cinder_sys_admin.user = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] service_user.auth_section = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] service_user.auth_type = password {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] service_user.cafile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] service_user.certfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] service_user.collect_timing = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] service_user.insecure = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] service_user.keyfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] service_user.send_service_user_token = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] service_user.split_loggers = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] service_user.timeout = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance.auth_section = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance.auth_type = password {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance.certfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance.collect_timing = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance.insecure = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance.keyfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance.region_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance.split_loggers = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] glance.timeout = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.backend_availability_zone = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.chap_password = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.chap_username = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.disk_geometry = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.driver_client_cert = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.driver_client_cert_key = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.driver_data_namespace = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.driver_use_ssl = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.enable_unsupported_driver = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.extra_capabilities = {} {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.filter_function = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.goodness_function = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.iscsi_target_flags = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.iscsi_write_cache = on {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.iser_helper = tgtadm {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.iser_ip_address = 192.168.122.228 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.iser_port = 3260 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.lvm_mirrors = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.lvm_share_target = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.lvm_type = auto {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.num_shell_tries = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.nvmet_port_id = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.replication_device = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.report_discard_supported = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.reserved_percentage = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.scst_target_driver = iscsi {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.scst_target_iqn_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.storage_protocol = iSCSI {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.target_helper = tgtadm {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.target_ip_address = 192.168.122.228 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.target_port = 3260 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.target_protocol = iscsi {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.trace_flags = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.unique_fqdn_network = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.use_chap_auth = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.volume_backend_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.volume_clear = zero {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.volume_clear_ionice = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.volume_clear_size = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.volume_group = cinder-volumes {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_reports.file_event_handler = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_reports.log_dir = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.backend_availability_zone = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.backend_host = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.chap_password = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack sudo[76769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.chap_username = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.chiscsi_conf = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.disk_geometry = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.driver_client_cert = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.driver_data_namespace = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack sudo[76769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.driver_use_ssl = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.extra_capabilities = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.filter_function = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.goodness_function = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.iser_helper = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.iser_ip_address = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.iser_port = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.iser_target_prefix = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.lvm_conf_file = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.lvm_mirrors = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.lvm_share_target = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.lvm_type = auto {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.num_shell_tries = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.nvmet_port_id = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.replication_device = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.report_discard_supported = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.reserved_percentage = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.scst_target_driver = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.storage_protocol = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.target_helper = lioadm {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.target_ip_address = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.target_port = 3260 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.target_protocol = iscsi {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.trace_flags = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.use_chap_auth = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.volume_clear = zero {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.volume_clear_size = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] lvmdriver-1.volumes_dir = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.ssl = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.ssl_version = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_notifications.driver = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_notifications.retry = -1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] oslo_messaging_notifications.transport_url = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] key_manager.fixed_key = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.barbican_api_version = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.barbican_endpoint = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.barbican_endpoint_type = public {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.barbican_region_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.cafile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.certfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.collect_timing = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.insecure = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.keyfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.number_of_retries = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.retry_delay = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.send_service_user_token = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.split_loggers = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.timeout = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.verify_ssl = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican.verify_ssl_path = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican_service_user.auth_section = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican_service_user.auth_type = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican_service_user.cafile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican_service_user.certfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican_service_user.collect_timing = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican_service_user.insecure = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican_service_user.keyfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican_service_user.split_loggers = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] barbican_service_user.timeout = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] vault.approle_role_id = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] vault.approle_secret_id = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] vault.auth_method = approle {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] vault.auth_path = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] vault.kv_mountpoint = secret {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] vault.kv_path = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] vault.kv_version = 2 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] vault.namespace = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] vault.root_token_id = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] vault.ssl_ca_crt_file = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] vault.timeout = 60.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] vault.token_file = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] vault.token_role = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] vault.use_ssl = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:29:19 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] ******************************************************************************** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 19 17:29:19 devstack sudo[76769]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:19 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.368s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:19 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:19 devstack sudo[76800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 17:29:19 devstack sudo[76800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:20 devstack sudo[76800]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:20 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.340s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:20 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:29:20 devstack cinder-volume[76765]: INFO cinder.brick.local_dev.lvm [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 19 17:29:20 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:20 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:20 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:20 devstack sudo[76937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 17:29:20 devstack sudo[76937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:20 devstack sudo[76937]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:20 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:20 devstack cinder-volume[76765]: DEBUG cinder.brick.local_dev.lvm [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76765) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 19 17:29:20 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:20 devstack sudo[77032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 17:29:20 devstack sudo[77032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:21 devstack sudo[77032]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.504s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:21 devstack sudo[77214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 17:29:21 devstack sudo[77214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:21 devstack sudo[77214]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:21 devstack sudo[77306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 19 17:29:21 devstack sudo[77306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:21 devstack sudo[77306]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.316s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:21 devstack sudo[77384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 17:29:21 devstack sudo[77384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:21 devstack sudo[77384]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:22 devstack sudo[77392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 17:29:22 devstack sudo[77392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:22 devstack sudo[77392]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:22 devstack sudo[77470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 17:29:22 devstack sudo[77470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:22 devstack sudo[77470]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:22 devstack sudo[77479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 17:29:22 devstack sudo[77479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:22 devstack sudo[77479]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:22 devstack sudo[77563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 17:29:22 devstack sudo[77563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:23 devstack sudo[77563]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:23 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:23 devstack cinder-volume[76765]: INFO cinder.volume.drivers.lvm [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 19 17:29:23 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:23 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:23 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:23 devstack sudo[77567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 17:29:23 devstack sudo[77567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:23 devstack sudo[77567]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:23 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:23 devstack cinder-volume[76765]: DEBUG cinder.volume.drivers.lvm [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Updating volume stats {{(pid=76765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 19 17:29:23 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:23 devstack sudo[77570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 17:29:23 devstack sudo[77570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:23 devstack sudo[77570]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:23 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:23 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:23 devstack sudo[77573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 17:29:23 devstack sudo[77573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:23 devstack sudo[77573]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:23 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:23 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:23 devstack sudo[77582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 17:29:23 devstack sudo[77582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:24 devstack sudo[77582]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:24 devstack sudo[77585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 17:29:24 devstack sudo[77585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:24 devstack sudo[77585]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:24 devstack cinder-volume[76765]: INFO cinder.volume.driver [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Driver hasn't implemented _init_vendor_properties() Jul 19 17:29:24 devstack cinder-volume[76765]: DEBUG cinder.volume.driver [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76765) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 19 17:29:24 devstack cinder-volume[76765]: DEBUG oslo_db.sqlalchemy.engines [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76765) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 17:29:24 devstack cinder-volume[76765]: DEBUG dbcounter [-] [76765] Writer thread running {{(pid=76765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 19 17:29:24 devstack cinder-volume[76765]: DEBUG cinder.db.api [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Building query based on filter {{(pid=76765) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 19 17:29:24 devstack cinder-volume[76765]: DEBUG cinder.image.image_utils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76765) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 19 17:29:24 devstack cinder-volume[76765]: INFO cinder.keymgr.migration [None req-08801d38-84ee-4644-9213-a3be7dd30918 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 19 17:29:24 devstack cinder-volume[76765]: DEBUG cinder.volume.drivers.lvm [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Updating volume stats {{(pid=76765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 19 17:29:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:24 devstack sudo[77588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 17:29:24 devstack sudo[77588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:24 devstack sudo[77588]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:24 devstack sudo[77593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 17:29:24 devstack sudo[77593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:25 devstack sudo[77593]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:25 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:25 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:25 devstack sudo[77596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 17:29:25 devstack sudo[77596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:25 devstack sudo[77596]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:25 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:25 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:25 devstack sudo[77599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 17:29:25 devstack sudo[77599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:25 devstack sudo[77599]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:25 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:25 devstack cinder-volume[76765]: DEBUG cinder.manager [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Notifying Schedulers of capabilities ... {{(pid=76765) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:29:25 devstack cinder-volume[76765]: INFO cinder.volume.manager [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Driver initialization completed successfully. Jul 19 17:29:25 devstack cinder-volume[76765]: INFO cinder.manager [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Initiating service 2 cleanup Jul 19 17:29:25 devstack cinder-volume[76765]: INFO cinder.manager [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Service 2 cleanup completed. Jul 19 17:29:25 devstack cinder-volume[76765]: DEBUG cinder.service [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Creating RPC server for service cinder-volume {{(pid=76765) start /opt/stack/cinder/cinder/service.py:231}} Jul 19 17:29:25 devstack cinder-volume[76765]: DEBUG cinder.service [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76765) start /opt/stack/cinder/cinder/service.py:237}} Jul 19 17:29:25 devstack cinder-volume[76765]: INFO cinder.volume.manager [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 19 17:29:25 devstack cinder-volume[76765]: DEBUG cinder.volume.drivers.lvm [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Updating volume stats {{(pid=76765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 19 17:29:25 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:25 devstack sudo[77605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 17:29:25 devstack sudo[77605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:26 devstack sudo[77605]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:26 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:26 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:26 devstack sudo[77608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 17:29:26 devstack sudo[77608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:26 devstack sudo[77608]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:26 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:26 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:26 devstack sudo[77611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 17:29:26 devstack sudo[77611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:26 devstack sudo[77611]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:26 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:26 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:29:26 devstack sudo[77614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 17:29:26 devstack sudo[77614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:29:26 devstack sudo[77614]: pam_unix(sudo:session): session closed for user root Jul 19 17:29:26 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:29:26 devstack cinder-volume[76765]: INFO cinder.volume.manager [None req-30c75011-0203-48f1-b792-82f4d8189438 None None] Driver post RPC initialization completed successfully. Jul 19 17:29:29 devstack cinder-volume[76614]: DEBUG dbcounter [-] [76614] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:29:36 devstack cinder-volume[76765]: DEBUG dbcounter [-] [76765] Writing DB stats cinder:SELECT=4 {{(pid=76765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:29:36 devstack cinder-volume[76765]: DEBUG dbcounter [-] [76765] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:30:08 devstack cinder-volume[76765]: DEBUG oslo_service.periodic_task [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running periodic task VolumeManager._thread_info {{(pid=76765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:30:08 devstack cinder-volume[76765]: DEBUG cinder.volume.manager [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] thread count: 6 {{(pid=76765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:30:08 devstack cinder-volume[76765]: DEBUG cinder.volume.manager [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] thread info: [<_MainThread(MainThread, started 137297382928512)>, , , , , ] {{(pid=76765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:31:08 devstack cinder-volume[76765]: DEBUG oslo_service.periodic_task [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:31:08 devstack cinder-volume[76765]: DEBUG cinder.volume.drivers.lvm [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Updating volume stats {{(pid=76765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 19 17:31:08 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:31:08 devstack sudo[82845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 17:31:08 devstack sudo[82845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:31:09 devstack sudo[82845]: pam_unix(sudo:session): session closed for user root Jul 19 17:31:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:31:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:31:09 devstack sudo[82848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 17:31:09 devstack sudo[82848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:31:09 devstack sudo[82848]: pam_unix(sudo:session): session closed for user root Jul 19 17:31:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:31:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:31:09 devstack sudo[82851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 17:31:09 devstack sudo[82851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:31:09 devstack sudo[82851]: pam_unix(sudo:session): session closed for user root Jul 19 17:31:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:31:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:31:09 devstack sudo[82854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 17:31:09 devstack sudo[82854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:31:09 devstack sudo[82854]: pam_unix(sudo:session): session closed for user root Jul 19 17:31:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:31:09 devstack cinder-volume[76765]: DEBUG cinder.manager [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Notifying Schedulers of capabilities ... {{(pid=76765) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:31:09 devstack cinder-volume[76765]: DEBUG oslo_service.periodic_task [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running periodic task VolumeManager._thread_info {{(pid=76765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:31:09 devstack cinder-volume[76765]: DEBUG cinder.volume.manager [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] thread count: 6 {{(pid=76765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:31:09 devstack cinder-volume[76765]: DEBUG cinder.volume.manager [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] thread info: [<_MainThread(MainThread, started 137297382928512)>, , , , , ] {{(pid=76765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:31:36 devstack cinder-volume[76765]: DEBUG dbcounter [-] [76765] Writing DB stats cinder:SELECT=1 {{(pid=76765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:31:36 devstack cinder-volume[76765]: DEBUG dbcounter [-] [76765] Writing DB stats cinder:UPDATE=1 {{(pid=76765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:32:08 devstack cinder-volume[76765]: DEBUG oslo_service.periodic_task [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:32:08 devstack cinder-volume[76765]: DEBUG cinder.volume.drivers.lvm [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Updating volume stats {{(pid=76765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 19 17:32:08 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:32:08 devstack sudo[84525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 17:32:08 devstack sudo[84525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:32:09 devstack sudo[84525]: pam_unix(sudo:session): session closed for user root Jul 19 17:32:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:32:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:32:09 devstack sudo[84530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 17:32:09 devstack sudo[84530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:32:09 devstack sudo[84530]: pam_unix(sudo:session): session closed for user root Jul 19 17:32:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:32:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:32:09 devstack sudo[84542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 17:32:09 devstack sudo[84542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:32:09 devstack sudo[84542]: pam_unix(sudo:session): session closed for user root Jul 19 17:32:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:32:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:32:09 devstack sudo[84548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 17:32:09 devstack sudo[84548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:32:09 devstack sudo[84548]: pam_unix(sudo:session): session closed for user root Jul 19 17:32:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:32:09 devstack cinder-volume[76765]: DEBUG cinder.manager [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Notifying Schedulers of capabilities ... {{(pid=76765) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:32:09 devstack cinder-volume[76765]: DEBUG oslo_service.periodic_task [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running periodic task VolumeManager._thread_info {{(pid=76765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:32:09 devstack cinder-volume[76765]: DEBUG cinder.volume.manager [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] thread count: 6 {{(pid=76765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:32:09 devstack cinder-volume[76765]: DEBUG cinder.volume.manager [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] thread info: [<_MainThread(MainThread, started 137297382928512)>, , , , , ] {{(pid=76765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:33:08 devstack cinder-volume[76765]: DEBUG oslo_service.periodic_task [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:33:08 devstack cinder-volume[76765]: DEBUG cinder.volume.drivers.lvm [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Updating volume stats {{(pid=76765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 19 17:33:08 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:33:08 devstack sudo[85923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 19 17:33:08 devstack sudo[85923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:33:09 devstack sudo[85923]: pam_unix(sudo:session): session closed for user root Jul 19 17:33:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:33:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:33:09 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 17:33:09 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:33:09 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Jul 19 17:33:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:33:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:33:09 devstack sudo[85932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 19 17:33:09 devstack sudo[85932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:33:09 devstack sudo[85932]: pam_unix(sudo:session): session closed for user root Jul 19 17:33:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:33:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:33:09 devstack sudo[85936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 19 17:33:09 devstack sudo[85936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:33:09 devstack sudo[85936]: pam_unix(sudo:session): session closed for user root Jul 19 17:33:09 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:33:09 devstack cinder-volume[76765]: DEBUG cinder.manager [None req-ea2cc783-511b-4057-a24c-ac94dd408482 None None] Notifying Schedulers of capabilities ... {{(pid=76765) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:33:36 devstack cinder-volume[76765]: DEBUG dbcounter [-] [76765] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:33:48 devstack cinder-volume[76614]: INFO oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Caught SIGTERM, stopping children Jul 19 17:33:48 devstack cinder-volume[76614]: DEBUG oslo_concurrency.lockutils [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Acquiring lock "singleton_lock" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 19 17:33:48 devstack cinder-volume[76614]: DEBUG oslo_concurrency.lockutils [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Acquired lock "singleton_lock" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 19 17:33:48 devstack cinder-volume[76614]: DEBUG oslo_concurrency.lockutils [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Releasing lock "singleton_lock" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 19 17:33:48 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Stop services. {{(pid=76614) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 19 17:33:48 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Killing children. {{(pid=76614) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 19 17:33:48 devstack cinder-volume[76614]: INFO oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Waiting on 1 children to exit Jul 19 17:33:50 devstack cinder-volume[76765]: DEBUG oslo_concurrency.lockutils [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Acquiring lock "singleton_lock" {{(pid=76765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 19 17:33:50 devstack cinder-volume[76765]: DEBUG oslo_concurrency.lockutils [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Acquired lock "singleton_lock" {{(pid=76765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 19 17:33:50 devstack cinder-volume[76765]: DEBUG oslo_concurrency.lockutils [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Releasing lock "singleton_lock" {{(pid=76765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 19 17:33:50 devstack cinder-volume[76765]: WARNING amqp [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 19 17:33:50 devstack cinder-volume[76765]: WARNING amqp [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 19 17:33:50 devstack cinder-volume[76614]: INFO oslo_service.backend._eventlet.service [None req-0528b08f-0ea8-4e43-81ce-f04e50ac46ef None None] Child 76765 exited with status 0 Jul 19 17:33:51 devstack cinder-volume[86865]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 19 17:33:51 devstack cinder-volume[86865]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 19 17:33:51 devstack cinder-volume[86865]: we strongly recommend against using it for new projects. Jul 19 17:33:51 devstack cinder-volume[86865]: If you are already using Eventlet, we recommend migrating to a different Jul 19 17:33:51 devstack cinder-volume[86865]: framework. For more detail see Jul 19 17:33:51 devstack cinder-volume[86865]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 19 17:33:51 devstack cinder-volume[86865]: import eventlet # noqa Jul 19 17:33:53 devstack cinder-volume[86865]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 19 17:33:53 devstack cinder-volume[86865]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 19 17:33:53 devstack cinder-volume[86865]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 19 17:33:54 devstack cinder-volume[86865]: INFO dbcounter [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Registered counter for database cinder Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_db.sqlalchemy.engines [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86865) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG dbcounter [-] [86865] Writer thread running {{(pid=86865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 19 17:33:54 devstack cinder-volume[86865]: INFO cinder.rpc [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 19 17:33:54 devstack cinder-volume[86865]: INFO cinder.rpc [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_db.sqlalchemy.engines [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86865) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 17:33:54 devstack cinder-volume[86865]: INFO cinder.volume.manager [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Determined volume DB was empty at startup. Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG cinder.volume.manager [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86865) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 19 17:33:54 devstack cinder-volume[86865]: INFO cinder.volume.manager [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 19 17:33:54 devstack cinder-volume[86865]: WARNING stevedore.named [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 19 17:33:54 devstack cinder-volume[86865]: WARNING castellan.key_manager [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 19 17:33:54 devstack cinder-volume[86865]: WARNING cinder.keymgr.conf_key_mgr [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 19 17:33:54 devstack cinder-volume[86865]: INFO cinder.volume.manager [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_db.sqlalchemy.engines [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86865) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 17:33:54 devstack cinder-volume[86865]: INFO oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Starting 1 workers Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Started child 87080 {{(pid=86865) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Full set of CONF: {{(pid=86865) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] ******************************************************************************** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Configuration options gathered from: {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] ================================================================================ {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] allow_availability_zone_fallback = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] allow_compression_on_image_upload = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] allowed_direct_url_schemes = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] api_rate_limit = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] auth_strategy = keystone {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_availability_zone = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[87080]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_host = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_name = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_stats_polling_interval = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backup_api_class = cinder.backup.api.API {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backup_name_template = backup-%s {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backup_use_same_host = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backup_use_temp_snapshot = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] chap_password = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] chap_username = {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cinder_internal_tenant_project_id = 793ac77d183649a9bda71921df909e2e {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cinder_internal_tenant_user_id = 0aa9c03d807446d89ca5c1c4bc38469a {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cluster = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] compression_format = gzip {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] compute_api_class = cinder.compute.nova.API {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] config_dir = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] config_source = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] control_exchange = openstack {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] debug = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] default_availability_zone = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] default_group_type = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] default_volume_type = QuobyteHD {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] disk_geometry = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] driver_client_cert = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] driver_client_cert_key = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] driver_data_namespace = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] driver_ssl_cert_path = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] driver_ssl_cert_verify = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] driver_use_ssl = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] enable_new_services = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] enable_unsupported_driver = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] enabled_backends = ['QuobyteHD'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] enforce_multipath_for_image_xfer = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] filter_function = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance_api_insecure = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance_api_servers = ['http://192.168.122.228/image'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance_api_ssl_compression = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance_ca_certificates_file = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance_catalog_info = image:glance:publicURL {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance_certfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance_keyfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance_num_retries = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance_request_timeout = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] goodness_function = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] graceful_shutdown_timeout = 5 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] group_api_class = cinder.group.api.API {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] host = devstack {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] image_compress_on_upload = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] image_conversion_address_space_limit = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] image_conversion_cpu_limit = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] image_conversion_disable = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] image_upload_use_cinder_backend = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] image_upload_use_internal_tenant = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] image_volume_cache_enabled = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] image_volume_cache_max_count = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] image_volume_cache_max_size_gb = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] init_host_max_objects_retrieval = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] instance_format = [instance: %(uuid)s] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] iscsi_target_flags = {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] iscsi_write_cache = on {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] iser_helper = tgtadm {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] iser_ip_address = 192.168.122.228 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] iser_port = 3260 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[87080]: INFO cinder.volume.manager [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Starting volume driver QuobyteDriver (1.2) Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] log_color = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[87080]: DEBUG cinder.volume.drivers.remotefs [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87080) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] log_config_append = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] log_dir = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] log_file = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] log_options = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] log_rotate_interval = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] log_rotate_interval_type = days {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] log_rotation_type = none {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] max_age = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] max_logfile_count = 30 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] max_logfile_size_mb = 200 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] max_over_subscription_ratio = 20.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] message_reap_interval = 86400 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] message_ttl = 2592000 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] migration_create_volume_timeout_secs = 300 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] monkey_patch = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] monkey_patch_modules = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] my_ip = 192.168.122.228 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] no_snapshot_gb_quota = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] num_iser_scan_tries = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] num_shell_tries = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] num_volume_device_scan_tries = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] nvmeof_conn_info_version = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] nvmet_ns_id = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] nvmet_port_id = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] osapi_max_limit = 1000 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] osapi_volume_ext_list = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] osapi_volume_listen = 0.0.0.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] osapi_volume_listen_port = 8776 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] osapi_volume_use_ssl = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] osapi_volume_workers = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] per_volume_size_limit = -1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] periodic_fuzzy_delay = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] periodic_interval = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] project_id_regex = [0-9a-f\-]+ {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] public_endpoint = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] publish_errors = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] quota_backup_gigabytes = 1000 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] quota_backups = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] quota_gigabytes = 1000 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] quota_groups = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] quota_snapshots = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] quota_volumes = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] rate_limit_burst = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] rate_limit_except_level = CRITICAL {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] rate_limit_interval = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] reinit_driver_count = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] replication_device = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] report_discard_supported = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] report_interval = 120 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] reservation_clean_interval = 86400 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] reservation_expire = 86400 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] reserved_image_namespaces = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] reserved_percentage = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] rpc_response_timeout = 120 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] run_external_periodic_tasks = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] scst_target_driver = iscsi {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] scst_target_iqn_name = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] service_down_time = 720 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] shell_completion = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] snapshot_name_template = snapshot-%s {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] split_loggers = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] state_path = /opt/stack/data/cinder {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] storage_availability_zone = nova {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] storage_protocol = iSCSI {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] syslog_log_facility = LOG_USER {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] target_helper = lioadm {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] target_ip_address = 192.168.122.228 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] target_port = 3260 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] target_protocol = iscsi {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] target_secondary_ip_addresses = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] trace_flags = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] transfer_api_class = cinder.transfer.api.API {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] transport_url = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] until_refresh = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] use_chap_auth = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] use_default_quota_class = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] use_journal = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] use_json = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] use_multipath_for_image_xfer = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] use_stderr = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] use_syslog = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] verify_glance_signatures = enabled {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] volume_api_class = cinder.volume.api.API {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] volume_backend_name = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] volume_clear = zero {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] volume_clear_ionice = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] volume_clear_size = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] volume_copy_bps_limit = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] volume_dd_blocksize = 1M {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] volume_name_template = volume-%s {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] volume_service_inithost_offload = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] volume_usage_audit_period = month {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] zoning_mode = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:33:54 devstack cinder-volume[87080]: DEBUG cinder.volume.drivers.quobyte [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87080) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 19 17:33:54 devstack cinder-volume[87080]: WARNING cinder.volume.drivers.quobyte [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 19 17:33:54 devstack cinder-volume[87080]: WARNING cinder.volume.drivers.quobyte [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_concurrency.disable_process_locking = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:54 devstack cinder-volume[87080]: DEBUG oslo_concurrency.processutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Running cmd (subprocess): mount.quobyte {{(pid=87080) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.auth_section = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.auth_type = password {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.auth_version = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.cache = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:54 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.certfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.delay_auth_decision = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.http_connect_timeout = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.include_service_catalog = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.insecure = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.interface = public {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.keyfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcache_password = {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcache_username = {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.region_name = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.service_token_roles_required = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.service_type = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.token_cache_time = 300 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.228/identity {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.backend = dogpile.cache.null {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.backend_argument = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.backend_expiration_time = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.config_prefix = cache.oslo {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.debug_cache_backend = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.enable_retry_client = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.enable_socket_keepalive = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.enabled = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.expiration_time = 600 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.hashclient_retry_attempts = 2 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.memcache_dead_retry = 300 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.memcache_pool_maxsize = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.memcache_sasl_enabled = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.password = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.proxies = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.redis_db = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.redis_sentinel_service_name = mymaster {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.redis_server = localhost:6379 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.retry_attempts = 2 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.retry_delay = 0.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.socket_keepalive_count = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.socket_keepalive_idle = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.socket_keepalive_interval = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.socket_timeout = 1.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.tls_allowed_ciphers = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.tls_cafile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.tls_certfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.tls_enabled = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.tls_keyfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cache.username = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] coordination.backend_url = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.asyncio_connection = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.asyncio_slave_connection = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.backend = sqlalchemy {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.connection = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.connection_debug = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.connection_parameters = {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.connection_recycle_time = 3600 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.connection_trace = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.db_inc_retry_interval = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.db_max_retries = 20 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.db_max_retry_interval = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.db_retry_interval = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.max_overflow = 50 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.max_pool_size = 5 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.max_retries = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.mysql_wsrep_sync_wait = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.pool_timeout = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.retry_interval = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.slave_connection = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.sqlite_synchronous = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.synchronous_reader = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] database.use_db_reconnect = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] profiler.connection_string = messaging:// {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] profiler.enabled = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] profiler.es_doc_type = notification {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] profiler.es_scroll_size = 10000 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] profiler.es_scroll_time = 2m {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] profiler.filter_error_trace = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] profiler.hmac_keys = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] profiler.sentinel_service_name = mymaster {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack quobyte-client[87083]: Reading configuration file: /etc/quobyte/client.cfg Jul 19 17:33:55 devstack quobyte-client[87083]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] profiler.socket_timeout = 0.1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] profiler.trace_requests = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] profiler.trace_sqlalchemy = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] profiler_jaeger.process_tags = {} {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] profiler_jaeger.service_name_prefix = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] profiler_otlp.service_name_prefix = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG oslo_concurrency.processutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] CMD "mount.quobyte" returned: 1 in 0.076s {{(pid=87080) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG oslo_concurrency.lockutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87080) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_policy.enforce_new_defaults = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG oslo_concurrency.lockutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87080) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_policy.policy_default_rule = default {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG cinder.volume.drivers.quobyte [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87080) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:33:55 devstack cinder-volume[87080]: INFO cinder.volume.drivers.quobyte [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c ... Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG oslo_concurrency.processutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 -c /etc/quobyte/client-cinder.cfg {{(pid=87080) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_policy.policy_file = policy.yaml {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_policy.remote_timeout = 60.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] privsep_osbrick.group = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] privsep_osbrick.helper_command = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] privsep_osbrick.user = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cinder_sys_admin.group = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cinder_sys_admin.helper_command = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] cinder_sys_admin.user = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] service_user.auth_section = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] service_user.auth_type = password {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] service_user.cafile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] service_user.certfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] service_user.collect_timing = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] service_user.insecure = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] service_user.keyfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] service_user.send_service_user_token = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] service_user.split_loggers = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] service_user.timeout = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance.auth_section = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance.auth_type = password {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance.certfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance.collect_timing = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance.insecure = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance.keyfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance.region_name = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance.split_loggers = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] glance.timeout = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.backend_availability_zone = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.chap_password = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.chap_username = {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack sudo[87084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 -c /etc/quobyte/client-cinder.cfg Jul 19 17:33:55 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.disk_geometry = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.driver_client_cert = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.driver_client_cert_key = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.driver_data_namespace = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.driver_use_ssl = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.enable_unsupported_driver = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.extra_capabilities = {} {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.filter_function = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.goodness_function = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.iscsi_target_flags = {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.iscsi_write_cache = on {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.iser_helper = tgtadm {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.iser_ip_address = 192.168.122.228 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.iser_port = 3260 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.nas_host = {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.nas_login = admin {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.nas_mount_options = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.nas_password = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.nas_private_key = {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.nas_share_path = {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.nas_ssh_port = 22 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.num_shell_tries = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.nvmet_port_id = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.quobyte_client_cfg = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.quobyte_volume_url = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.replication_device = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.report_discard_supported = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.reserved_percentage = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.scst_target_driver = iscsi {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.scst_target_iqn_name = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.storage_protocol = iSCSI {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.target_helper = tgtadm {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.target_ip_address = 192.168.122.228 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.target_port = 3260 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.target_protocol = iscsi {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.trace_flags = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.unique_fqdn_network = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.use_chap_auth = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.volume_backend_name = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.volume_clear = zero {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.volume_clear_ionice = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.volume_clear_size = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_reports.file_event_handler = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_reports.log_dir = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.backend_availability_zone = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.backend_host = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.chap_password = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.chap_username = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.chiscsi_conf = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.disk_geometry = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.driver_client_cert = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.driver_client_cert_key = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.driver_data_namespace = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.driver_use_ssl = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.extra_capabilities = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.filter_function = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.goodness_function = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.iscsi_target_flags = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.iscsi_write_cache = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.iser_helper = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.iser_ip_address = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.iser_port = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.iser_target_prefix = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.nas_host = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.nas_login = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.nas_mount_options = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.nas_password = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.nas_private_key = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.nas_share_path = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.nas_ssh_port = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.num_shell_tries = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.nvmet_ns_id = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.nvmet_port_id = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.replication_device = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.report_discard_supported = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.reserved_percentage = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.scst_target_driver = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.storage_protocol = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.target_helper = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.target_ip_address = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.target_port = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.target_prefix = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.target_protocol = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.trace_flags = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.unique_fqdn_network = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.use_chap_auth = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.volume_clear = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.volume_clear_ionice = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.volume_clear_size = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] QuobyteHD.volumes_dir = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.ssl = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.ssl_version = {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_notifications.driver = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_notifications.retry = -1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] oslo_messaging_notifications.transport_url = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] key_manager.fixed_key = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.barbican_api_version = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.barbican_endpoint = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.barbican_endpoint_type = public {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.barbican_region_name = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.cafile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.certfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.collect_timing = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.insecure = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.keyfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.number_of_retries = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.retry_delay = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.send_service_user_token = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.split_loggers = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.timeout = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.verify_ssl = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican.verify_ssl_path = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican_service_user.auth_section = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican_service_user.auth_type = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican_service_user.cafile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican_service_user.certfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican_service_user.collect_timing = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican_service_user.insecure = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican_service_user.keyfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican_service_user.split_loggers = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] barbican_service_user.timeout = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] vault.approle_role_id = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] vault.approle_secret_id = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] vault.auth_method = approle {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] vault.auth_path = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] vault.kv_mountpoint = secret {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] vault.kv_path = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] vault.kv_version = 2 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] vault.namespace = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] vault.root_token_id = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] vault.ssl_ca_crt_file = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] vault.timeout = 60.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] vault.token_file = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] vault.token_role = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] vault.use_ssl = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:33:55 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] ******************************************************************************** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 19 17:33:55 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG oslo_concurrency.processutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.389s {{(pid=87080) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:33:55 devstack cinder-volume[87080]: INFO cinder.volume.drivers.quobyte [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c succeeded Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG cinder.volume.drivers.quobyte [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87080) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG oslo_concurrency.lockutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.402s {{(pid=87080) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG oslo_concurrency.processutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87080) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:33:55 devstack sudo[87153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:33:55 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:33:55 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG oslo_concurrency.processutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.237s {{(pid=87080) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:33:55 devstack cinder-volume[87080]: INFO cinder.volume.driver [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Driver hasn't implemented _init_vendor_properties() Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG cinder.volume.driver [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87080) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG oslo_db.sqlalchemy.engines [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87080) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG dbcounter [-] [87080] Writer thread running {{(pid=87080) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG cinder.db.api [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Building query based on filter {{(pid=87080) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG cinder.image.image_utils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87080) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 19 17:33:55 devstack cinder-volume[87080]: INFO cinder.keymgr.migration [None req-b24f6577-14e0-4f38-94e1-a21c023cfdf8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG oslo_concurrency.lockutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87080) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG oslo_concurrency.lockutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87080) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG cinder.volume.drivers.quobyte [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87080) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG cinder.volume.drivers.quobyte [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87080) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG oslo_concurrency.lockutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87080) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:33:55 devstack cinder-volume[87080]: DEBUG oslo_concurrency.processutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87080) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:33:55 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:33:55 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:33:56 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Jul 19 17:33:56 devstack cinder-volume[87080]: DEBUG oslo_concurrency.processutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.230s {{(pid=87080) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:33:56 devstack cinder-volume[87080]: DEBUG cinder.manager [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Notifying Schedulers of capabilities ... {{(pid=87080) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:33:56 devstack cinder-volume[87080]: INFO cinder.volume.manager [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Driver initialization completed successfully. Jul 19 17:33:56 devstack cinder-volume[87080]: INFO cinder.manager [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Initiating service 3 cleanup Jul 19 17:33:56 devstack cinder-volume[87080]: INFO cinder.manager [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Service 3 cleanup completed. Jul 19 17:33:56 devstack cinder-volume[87080]: DEBUG cinder.service [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Creating RPC server for service cinder-volume {{(pid=87080) start /opt/stack/cinder/cinder/service.py:231}} Jul 19 17:33:56 devstack cinder-volume[87080]: DEBUG cinder.service [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87080) start /opt/stack/cinder/cinder/service.py:237}} Jul 19 17:33:56 devstack cinder-volume[87080]: INFO cinder.volume.manager [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 19 17:33:56 devstack cinder-volume[87080]: DEBUG oslo_concurrency.lockutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87080) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:33:56 devstack cinder-volume[87080]: DEBUG oslo_concurrency.lockutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87080) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:33:56 devstack cinder-volume[87080]: DEBUG cinder.volume.drivers.quobyte [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87080) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:33:56 devstack cinder-volume[87080]: DEBUG cinder.volume.drivers.quobyte [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87080) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:33:56 devstack cinder-volume[87080]: DEBUG oslo_concurrency.lockutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87080) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:33:56 devstack cinder-volume[87080]: DEBUG oslo_concurrency.processutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87080) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:33:56 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:33:56 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:33:56 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Jul 19 17:33:56 devstack cinder-volume[87080]: DEBUG oslo_concurrency.processutils [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.247s {{(pid=87080) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:33:56 devstack cinder-volume[87080]: INFO cinder.volume.manager [None req-06e2af6d-d3f1-49f3-8872-74a6ba47f85f None None] Driver post RPC initialization completed successfully. Jul 19 17:34:01 devstack cinder-volume[87080]: DEBUG oslo_concurrency.lockutils [None req-902cfef8-68a1-4368-8e01-7974ae176363 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87080) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:34:01 devstack cinder-volume[87080]: DEBUG oslo_concurrency.lockutils [None req-902cfef8-68a1-4368-8e01-7974ae176363 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87080) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:34:01 devstack cinder-volume[87080]: DEBUG cinder.volume.drivers.quobyte [None req-902cfef8-68a1-4368-8e01-7974ae176363 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87080) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:34:01 devstack cinder-volume[87080]: DEBUG cinder.volume.drivers.quobyte [None req-902cfef8-68a1-4368-8e01-7974ae176363 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87080) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:34:01 devstack cinder-volume[87080]: DEBUG oslo_concurrency.lockutils [None req-902cfef8-68a1-4368-8e01-7974ae176363 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87080) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:34:01 devstack cinder-volume[87080]: DEBUG oslo_concurrency.processutils [None req-902cfef8-68a1-4368-8e01-7974ae176363 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87080) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:34:01 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:34:01 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:34:01 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Jul 19 17:34:01 devstack cinder-volume[87080]: DEBUG oslo_concurrency.processutils [None req-902cfef8-68a1-4368-8e01-7974ae176363 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.241s {{(pid=87080) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:34:01 devstack cinder-volume[87080]: DEBUG cinder.manager [None req-902cfef8-68a1-4368-8e01-7974ae176363 None None] Notifying Schedulers of capabilities ... {{(pid=87080) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:34:01 devstack cinder-volume[86865]: INFO oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Caught SIGTERM, stopping children Jul 19 17:34:01 devstack cinder-volume[86865]: DEBUG oslo_concurrency.lockutils [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Acquiring lock "singleton_lock" {{(pid=86865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 19 17:34:01 devstack cinder-volume[86865]: DEBUG oslo_concurrency.lockutils [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Acquired lock "singleton_lock" {{(pid=86865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 19 17:34:01 devstack cinder-volume[86865]: DEBUG oslo_concurrency.lockutils [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Releasing lock "singleton_lock" {{(pid=86865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 19 17:34:01 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Stop services. {{(pid=86865) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 19 17:34:01 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Killing children. {{(pid=86865) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 19 17:34:01 devstack cinder-volume[86865]: INFO oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Waiting on 1 children to exit Jul 19 17:34:04 devstack cinder-volume[87080]: DEBUG oslo_concurrency.lockutils [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Acquiring lock "singleton_lock" {{(pid=87080) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 19 17:34:04 devstack cinder-volume[87080]: DEBUG oslo_concurrency.lockutils [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Acquired lock "singleton_lock" {{(pid=87080) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 19 17:34:04 devstack cinder-volume[87080]: DEBUG oslo_concurrency.lockutils [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Releasing lock "singleton_lock" {{(pid=87080) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 19 17:34:04 devstack cinder-volume[87080]: WARNING amqp [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 19 17:34:04 devstack cinder-volume[87080]: WARNING amqp [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 19 17:34:04 devstack cinder-volume[86865]: INFO oslo_service.backend._eventlet.service [None req-6e7204f4-4cfb-45f4-bdae-6b698e741cee None None] Child 87080 exited with status 0 Jul 19 17:34:05 devstack cinder-volume[87370]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 19 17:34:05 devstack cinder-volume[87370]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 19 17:34:05 devstack cinder-volume[87370]: we strongly recommend against using it for new projects. Jul 19 17:34:05 devstack cinder-volume[87370]: If you are already using Eventlet, we recommend migrating to a different Jul 19 17:34:05 devstack cinder-volume[87370]: framework. For more detail see Jul 19 17:34:05 devstack cinder-volume[87370]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 19 17:34:05 devstack cinder-volume[87370]: import eventlet # noqa Jul 19 17:34:08 devstack cinder-volume[87370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87370) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 19 17:34:08 devstack cinder-volume[87370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87370) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 19 17:34:08 devstack cinder-volume[87370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87370) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 19 17:34:09 devstack cinder-volume[87370]: INFO dbcounter [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] Registered counter for database cinder Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_db.sqlalchemy.engines [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87370) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG dbcounter [-] [87370] Writer thread running {{(pid=87370) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 19 17:34:09 devstack cinder-volume[87370]: INFO cinder.rpc [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 19 17:34:09 devstack cinder-volume[87370]: INFO cinder.rpc [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_db.sqlalchemy.engines [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87370) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 17:34:09 devstack cinder-volume[87370]: INFO cinder.volume.manager [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] Determined volume DB was empty at startup. Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG cinder.volume.manager [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87370) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 19 17:34:09 devstack cinder-volume[87370]: WARNING stevedore.named [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 19 17:34:09 devstack cinder-volume[87370]: WARNING castellan.key_manager [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 19 17:34:09 devstack cinder-volume[87370]: WARNING cinder.keymgr.conf_key_mgr [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 19 17:34:09 devstack cinder-volume[87370]: INFO cinder.volume.manager [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_db.sqlalchemy.engines [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87370) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 17:34:09 devstack cinder-volume[87370]: INFO oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] Starting 1 workers Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] Started child 87676 {{(pid=87370) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] Full set of CONF: {{(pid=87370) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] ******************************************************************************** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] Configuration options gathered from: {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] ================================================================================ {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] allow_availability_zone_fallback = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87676]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] allow_compression_on_image_upload = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] allowed_direct_url_schemes = [] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] api_rate_limit = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] auth_strategy = keystone {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_availability_zone = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_host = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_name = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_stats_polling_interval = 60 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backup_api_class = cinder.backup.api.API {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backup_name_template = backup-%s {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backup_use_same_host = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backup_use_temp_snapshot = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] chap_password = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] chap_username = {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cinder_internal_tenant_project_id = 793ac77d183649a9bda71921df909e2e {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cinder_internal_tenant_user_id = 0aa9c03d807446d89ca5c1c4bc38469a {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cluster = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] compression_format = gzip {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] compute_api_class = cinder.compute.nova.API {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] config_dir = [] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] config_source = [] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] control_exchange = openstack {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] debug = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] default_availability_zone = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] default_group_type = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] default_volume_type = QuobyteHD {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] disk_geometry = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] driver_client_cert = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] driver_client_cert_key = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] driver_data_namespace = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] driver_ssl_cert_path = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] driver_ssl_cert_verify = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] driver_use_ssl = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] enable_new_services = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] enable_unsupported_driver = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] enabled_backends = ['QuobyteHD'] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] enforce_multipath_for_image_xfer = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] filter_function = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance_api_insecure = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance_api_servers = ['http://192.168.122.228/image'] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance_api_ssl_compression = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance_ca_certificates_file = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance_catalog_info = image:glance:publicURL {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance_certfile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance_keyfile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance_num_retries = 3 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance_request_timeout = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] goodness_function = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] graceful_shutdown_timeout = 5 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] group_api_class = cinder.group.api.API {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] host = devstack {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] image_compress_on_upload = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] image_conversion_address_space_limit = 1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] image_conversion_cpu_limit = 60 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] image_conversion_disable = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] image_upload_use_cinder_backend = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] image_upload_use_internal_tenant = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] image_volume_cache_enabled = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] image_volume_cache_max_count = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] image_volume_cache_max_size_gb = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] init_host_max_objects_retrieval = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] instance_format = [instance: %(uuid)s] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] iscsi_target_flags = {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] iscsi_write_cache = on {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] iser_helper = tgtadm {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] iser_ip_address = 192.168.122.228 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] iser_port = 3260 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] log_color = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] log_config_append = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] log_dir = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] log_file = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] log_options = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] log_rotate_interval = 1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] log_rotate_interval_type = days {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] log_rotation_type = none {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] max_age = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] max_logfile_count = 30 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] max_logfile_size_mb = 200 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] max_over_subscription_ratio = 20.0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] message_reap_interval = 86400 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] message_ttl = 2592000 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] migration_create_volume_timeout_secs = 300 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] monkey_patch = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] monkey_patch_modules = [] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] my_ip = 192.168.122.228 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] no_snapshot_gb_quota = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] num_iser_scan_tries = 3 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] num_shell_tries = 3 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] num_volume_device_scan_tries = 3 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] nvmeof_conn_info_version = 1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Starting volume driver QuobyteDriver (1.2) Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] nvmet_ns_id = 10 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87676) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] nvmet_port_id = 1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] osapi_max_limit = 1000 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] osapi_volume_ext_list = [] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] osapi_volume_listen = 0.0.0.0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] osapi_volume_listen_port = 8776 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] osapi_volume_use_ssl = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] osapi_volume_workers = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] per_volume_size_limit = -1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] periodic_fuzzy_delay = 60 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] periodic_interval = 60 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] project_id_regex = [0-9a-f\-]+ {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] public_endpoint = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] publish_errors = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] quota_backup_gigabytes = 1000 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] quota_backups = 10 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] quota_gigabytes = 1000 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] quota_groups = 10 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] quota_snapshots = 10 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] quota_volumes = 10 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] rate_limit_burst = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] rate_limit_except_level = CRITICAL {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] rate_limit_interval = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] reinit_driver_count = 3 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] replication_device = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] report_discard_supported = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] report_interval = 120 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] reservation_clean_interval = 86400 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] reservation_expire = 86400 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] reserved_image_namespaces = [] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] reserved_percentage = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] rpc_response_timeout = 120 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] run_external_periodic_tasks = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] scst_target_driver = iscsi {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] scst_target_iqn_name = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] service_down_time = 720 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] shell_completion = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] snapshot_name_template = snapshot-%s {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] split_loggers = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] state_path = /opt/stack/data/cinder {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] storage_availability_zone = nova {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] storage_protocol = iSCSI {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] syslog_log_facility = LOG_USER {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] target_helper = lioadm {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] target_ip_address = 192.168.122.228 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] target_port = 3260 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] target_protocol = iscsi {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] target_secondary_ip_addresses = [] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] trace_flags = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] transfer_api_class = cinder.transfer.api.API {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] transport_url = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] until_refresh = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] use_chap_auth = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] use_default_quota_class = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] use_journal = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] use_json = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] use_multipath_for_image_xfer = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] use_stderr = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] use_syslog = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] verify_glance_signatures = enabled {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] volume_api_class = cinder.volume.api.API {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] volume_backend_name = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] volume_clear = zero {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] volume_clear_ionice = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] volume_clear_size = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] volume_copy_bps_limit = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] volume_dd_blocksize = 1M {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] volume_name_template = volume-%s {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] volume_service_inithost_offload = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] volume_usage_audit_period = month {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] zoning_mode = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_concurrency.disable_process_locking = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.auth_section = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.auth_type = password {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.auth_version = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.cache = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.certfile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.delay_auth_decision = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.http_connect_timeout = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.include_service_catalog = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.insecure = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.interface = public {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.keyfile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcache_password = {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcache_username = {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.region_name = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.service_token_roles_required = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.service_type = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.token_cache_time = 300 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.228/identity {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.backend = dogpile.cache.null {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.backend_argument = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.backend_expiration_time = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.config_prefix = cache.oslo {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.debug_cache_backend = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.enable_retry_client = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.enable_socket_keepalive = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.enabled = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.expiration_time = 600 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.hashclient_retry_attempts = 2 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.memcache_dead_retry = 300 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.memcache_pool_maxsize = 10 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.memcache_sasl_enabled = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.password = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.proxies = [] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.redis_db = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.redis_sentinel_service_name = mymaster {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.redis_server = localhost:6379 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.retry_attempts = 2 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.retry_delay = 0.0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.socket_keepalive_count = 1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.socket_keepalive_idle = 1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.socket_keepalive_interval = 1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.socket_timeout = 1.0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.tls_allowed_ciphers = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.tls_cafile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.tls_certfile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.tls_enabled = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.tls_keyfile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cache.username = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] coordination.backend_url = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.asyncio_connection = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.asyncio_slave_connection = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.backend = sqlalchemy {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.connection = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.connection_debug = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.connection_parameters = {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.connection_recycle_time = 3600 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.connection_trace = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.db_inc_retry_interval = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.db_max_retries = 20 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.db_max_retry_interval = 10 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.db_retry_interval = 1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.max_overflow = 50 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.max_pool_size = 5 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.max_retries = 10 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.mysql_wsrep_sync_wait = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.pool_timeout = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.retry_interval = 10 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.slave_connection = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.sqlite_synchronous = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.synchronous_reader = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] database.use_db_reconnect = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] profiler.connection_string = messaging:// {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] profiler.enabled = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] profiler.es_doc_type = notification {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] profiler.es_scroll_size = 10000 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] profiler.es_scroll_time = 2m {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] profiler.filter_error_trace = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] profiler.hmac_keys = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] profiler.sentinel_service_name = mymaster {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] profiler.socket_timeout = 0.1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] profiler.trace_requests = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] profiler.trace_sqlalchemy = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] profiler_jaeger.process_tags = {} {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] profiler_jaeger.service_name_prefix = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] profiler_otlp.service_name_prefix = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_policy.enforce_new_defaults = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_policy.policy_default_rule = default {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_policy.policy_file = policy.yaml {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_policy.remote_timeout = 60.0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87676) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.quobyte [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 19 17:34:09 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.quobyte [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] privsep_osbrick.group = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] privsep_osbrick.helper_command = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Running cmd (subprocess): mount.quobyte {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] privsep_osbrick.user = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cinder_sys_admin.group = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cinder_sys_admin.helper_command = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] cinder_sys_admin.user = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] service_user.auth_section = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] service_user.auth_type = password {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] service_user.cafile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] service_user.certfile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] service_user.collect_timing = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] service_user.insecure = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] service_user.keyfile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] service_user.send_service_user_token = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] service_user.split_loggers = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] service_user.timeout = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance.auth_section = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance.auth_type = password {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance.certfile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance.collect_timing = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance.insecure = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance.keyfile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance.region_name = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance.split_loggers = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] glance.timeout = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.backend_availability_zone = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.chap_password = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.chap_username = {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.disk_geometry = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.driver_client_cert = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.driver_client_cert_key = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.driver_data_namespace = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.driver_use_ssl = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.enable_unsupported_driver = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.extra_capabilities = {} {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.filter_function = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.goodness_function = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.iscsi_target_flags = {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.iscsi_write_cache = on {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.iser_helper = tgtadm {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.iser_ip_address = 192.168.122.228 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.iser_port = 3260 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.nas_host = {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.nas_login = admin {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.nas_mount_options = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.nas_password = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.nas_private_key = {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.nas_share_path = {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.nas_ssh_port = 22 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.num_shell_tries = 3 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.nvmet_port_id = 1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.quobyte_client_cfg = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.quobyte_volume_url = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.replication_device = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.report_discard_supported = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.reserved_percentage = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack quobyte-client[87685]: Reading configuration file: /etc/quobyte/client.cfg Jul 19 17:34:09 devstack quobyte-client[87685]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.scst_target_driver = iscsi {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.scst_target_iqn_name = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.storage_protocol = iSCSI {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.target_helper = tgtadm {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.target_ip_address = 192.168.122.228 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.target_port = 3260 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:34:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.target_protocol = iscsi {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.trace_flags = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.unique_fqdn_network = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.use_chap_auth = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.volume_backend_name = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.volume_clear = zero {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.volume_clear_ionice = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.volume_clear_size = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_reports.file_event_handler = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_reports.log_dir = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.backend_availability_zone = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.backend_host = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.chap_password = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.chap_username = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.chiscsi_conf = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.disk_geometry = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.driver_client_cert = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.driver_client_cert_key = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.driver_data_namespace = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.driver_use_ssl = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.extra_capabilities = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.filter_function = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.goodness_function = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.iscsi_target_flags = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.iscsi_write_cache = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.iser_helper = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.iser_ip_address = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.iser_port = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.iser_target_prefix = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.nas_host = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.nas_login = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.nas_mount_options = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.nas_password = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.nas_private_key = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.nas_share_path = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.nas_ssh_port = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.num_shell_tries = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.nvmet_ns_id = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.nvmet_port_id = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack sudo[87686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.replication_device = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.report_discard_supported = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.reserved_percentage = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.scst_target_driver = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.storage_protocol = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.target_helper = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.target_ip_address = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.target_port = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.target_prefix = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.target_protocol = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.trace_flags = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.unique_fqdn_network = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.use_chap_auth = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.volume_clear = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.volume_clear_ionice = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.volume_clear_size = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] QuobyteHD.volumes_dir = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.ssl = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.ssl_version = {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_notifications.driver = [] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_notifications.retry = -1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] oslo_messaging_notifications.transport_url = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] key_manager.fixed_key = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.barbican_api_version = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.barbican_endpoint = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.barbican_endpoint_type = public {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.barbican_region_name = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.cafile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.certfile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.collect_timing = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.insecure = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.keyfile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.number_of_retries = 60 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.retry_delay = 1 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.send_service_user_token = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.split_loggers = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.timeout = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.verify_ssl = True {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican.verify_ssl_path = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican_service_user.auth_section = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican_service_user.auth_type = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican_service_user.cafile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican_service_user.certfile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican_service_user.collect_timing = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican_service_user.insecure = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican_service_user.keyfile = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican_service_user.split_loggers = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] barbican_service_user.timeout = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] vault.approle_role_id = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] vault.approle_secret_id = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] vault.auth_method = approle {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] vault.auth_path = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] vault.kv_mountpoint = secret {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] vault.kv_path = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] vault.kv_version = 2 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] vault.namespace = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] vault.root_token_id = **** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] vault.ssl_ca_crt_file = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] vault.timeout = 60.0 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] vault.token_file = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] vault.token_role = None {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] vault.use_ssl = False {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 19 17:34:09 devstack cinder-volume[87370]: DEBUG oslo_service.backend._eventlet.service [None req-be4ad066-29b6-4710-a727-47e2bc4f95cb None None] ******************************************************************************** {{(pid=87370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 19 17:34:10 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.250s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:34:10 devstack cinder-volume[87676]: INFO cinder.volume.driver [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Driver hasn't implemented _init_vendor_properties() Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG cinder.volume.driver [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87676) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG oslo_db.sqlalchemy.engines [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writer thread running {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG cinder.db.api [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Building query based on filter {{(pid=87676) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87676) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:34:10 devstack cinder-volume[87676]: INFO cinder.keymgr.migration [None req-b76f3c9d-15be-465f-b407-bc5a03779583 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 19 17:34:10 devstack sudo[87699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:34:10 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:34:10 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.223s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:34:10 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Driver initialization completed successfully. Jul 19 17:34:10 devstack cinder-volume[87676]: INFO cinder.manager [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Initiating service 3 cleanup Jul 19 17:34:10 devstack cinder-volume[87676]: INFO cinder.manager [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Service 3 cleanup completed. Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG cinder.service [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Creating RPC server for service cinder-volume {{(pid=87676) start /opt/stack/cinder/cinder/service.py:231}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG cinder.service [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87676) start /opt/stack/cinder/cinder/service.py:237}} Jul 19 17:34:10 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:34:10 devstack sudo[87711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:34:10 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:34:10 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root Jul 19 17:34:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.228s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:34:10 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-549ec259-5e0f-43cb-bfac-b3b5c7faf383 None None] Driver post RPC initialization completed successfully. Jul 19 17:34:19 devstack cinder-volume[87370]: DEBUG dbcounter [-] [87370] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87370) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:34:20 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=2 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:34:20 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:34:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:34:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 6 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:34:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Flow 'volume_create_manager' (96904396-829c-41d0-ba97-8a4a9aa57415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b0eb2a-3879-48f9-b3b1-ade3ba99a068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b0eb2a-3879-48f9-b3b1-ade3ba99a068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1326114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db5fb55-fda8-418a-9091-7e260d9e11c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='658151268f0e46a99549e3ec06ee437d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:35:21Z,use_quota=True,user_id='53e5e663fa4643b8a23c3f3147ca96a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976c4237-45ed-4448-aeb9-4e1f49ba557f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976c4237-45ed-4448-aeb9-4e1f49ba557f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4f8b18-f231-49c2-b2a1-6c37d7f308b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4f8b18-f231-49c2-b2a1-6c37d7f308b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db5fb55-fda8-418a-9091-7e260d9e11c6', 'volume_name': 'volume-8db5fb55-fda8-418a-9091-7e260d9e11c6', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffd75ad-2ee7-4caf-8099-178f6d4c68ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffd75ad-2ee7-4caf-8099-178f6d4c68ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1114a4-8baa-497a-bc49-d56fbb680092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:20 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Volume 8db5fb55-fda8-418a-9091-7e260d9e11c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db5fb55-fda8-418a-9091-7e260d9e11c6', 'volume_size': 1} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1326114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db5fb55-fda8-418a-9091-7e260d9e11c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='658151268f0e46a99549e3ec06ee437d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:35:21Z,use_quota=True,user_id='53e5e663fa4643b8a23c3f3147ca96a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Creating volume 8db5fb55-fda8-418a-9091-7e260d9e11c6 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:35:20 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:35:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8db5fb55-fda8-418a-9091-7e260d9e11c6 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:35:20 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8db5fb55-fda8-418a-9091-7e260d9e11c6 1073741824 Jul 19 17:35:20 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:35:22 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Jul 19 17:35:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8db5fb55-fda8-418a-9091-7e260d9e11c6 1073741824" returned: 0 in 1.628s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:35:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8db5fb55-fda8-418a-9091-7e260d9e11c6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:35:22 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8db5fb55-fda8-418a-9091-7e260d9e11c6 Jul 19 17:35:22 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:35:23 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Jul 19 17:35:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8db5fb55-fda8-418a-9091-7e260d9e11c6" returned: 0 in 0.677s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:35:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] <== create_volume: return (2473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:35:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.479s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:35:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1114a4-8baa-497a-bc49-d56fbb680092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db5fb55-fda8-418a-9091-7e260d9e11c6', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd714ab9-46f8-40d3-b47a-1907882ad712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:23 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Volume volume-8db5fb55-fda8-418a-9091-7e260d9e11c6 (8db5fb55-fda8-418a-9091-7e260d9e11c6): created successfully Jul 19 17:35:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd714ab9-46f8-40d3-b47a-1907882ad712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Flow 'volume_create_manager' (96904396-829c-41d0-ba97-8a4a9aa57415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:35:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b1904a78-66fc-4d08-97a2-df8140fd78a3 tempest-DeleteServersTestJSON-1867841191 None] Created volume successfully. Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Flow 'volume_create_manager' (1829030d-9e43-4fec-90fc-dc6fb56b973f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e57614-3167-41e8-8b60-8a38eb0d0ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e57614-3167-41e8-8b60-8a38eb0d0ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1957537568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2792b9ab-7974-421f-ba2b-19243552ffcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d388d2d31fd04d7598566cfdfce4c882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:35:28Z,use_quota=True,user_id='37b51823aa044d08ba51ccee18a4dd43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120a6e32-1bc6-466f-8a49-1740f6320299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120a6e32-1bc6-466f-8a49-1740f6320299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e92983-2ecb-4ea0-9c64-b9db90d5f624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e92983-2ecb-4ea0-9c64-b9db90d5f624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2792b9ab-7974-421f-ba2b-19243552ffcf', 'volume_name': 'volume-2792b9ab-7974-421f-ba2b-19243552ffcf', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9340aec0-0e78-49ae-8720-893543e07e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9340aec0-0e78-49ae-8720-893543e07e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251753f1-b406-4364-ba3e-5c6aca5ec160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:28 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Volume 2792b9ab-7974-421f-ba2b-19243552ffcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2792b9ab-7974-421f-ba2b-19243552ffcf', 'volume_size': 1} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1957537568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2792b9ab-7974-421f-ba2b-19243552ffcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d388d2d31fd04d7598566cfdfce4c882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:35:28Z,use_quota=True,user_id='37b51823aa044d08ba51ccee18a4dd43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Creating volume 2792b9ab-7974-421f-ba2b-19243552ffcf {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:35:28 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:35:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2792b9ab-7974-421f-ba2b-19243552ffcf 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:35:28 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2792b9ab-7974-421f-ba2b-19243552ffcf 1073741824 Jul 19 17:35:28 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:35:30 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Jul 19 17:35:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2792b9ab-7974-421f-ba2b-19243552ffcf 1073741824" returned: 0 in 1.830s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:35:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2792b9ab-7974-421f-ba2b-19243552ffcf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:35:30 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2792b9ab-7974-421f-ba2b-19243552ffcf Jul 19 17:35:30 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:35:31 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Jul 19 17:35:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2792b9ab-7974-421f-ba2b-19243552ffcf" returned: 0 in 0.572s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:35:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] <== create_volume: return (2509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:35:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.512s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:35:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251753f1-b406-4364-ba3e-5c6aca5ec160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2792b9ab-7974-421f-ba2b-19243552ffcf', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ab05a1-0c95-40f6-9cae-23ac440e4827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:31 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Volume volume-2792b9ab-7974-421f-ba2b-19243552ffcf (2792b9ab-7974-421f-ba2b-19243552ffcf): created successfully Jul 19 17:35:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ab05a1-0c95-40f6-9cae-23ac440e4827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Flow 'volume_create_manager' (1829030d-9e43-4fec-90fc-dc6fb56b973f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:35:31 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-269be731-8cac-444a-9709-a313977695b1 tempest-VolumesAdminNegativeTest-236600902 None] Created volume successfully. Jul 19 17:35:31 devstack cinder-volume[87676]: WARNING py.warnings [req-6724796f-d230-4e87-9b7a-7e2e37bcb273 req-10740828-b1f7-4585-a4bf-ab75c2fa46c4 tempest-DeleteServersTestJSON-1867841191 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 19 17:35:31 devstack cinder-volume[87676]: .first() Jul 19 17:35:31 devstack cinder-volume[87676]: Jul 19 17:35:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-6724796f-d230-4e87-9b7a-7e2e37bcb273 req-10740828-b1f7-4585-a4bf-ab75c2fa46c4 tempest-DeleteServersTestJSON-1867841191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:35:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-6724796f-d230-4e87-9b7a-7e2e37bcb273 req-10740828-b1f7-4585-a4bf-ab75c2fa46c4 tempest-DeleteServersTestJSON-1867841191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:35:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-6724796f-d230-4e87-9b7a-7e2e37bcb273 req-10740828-b1f7-4585-a4bf-ab75c2fa46c4 tempest-DeleteServersTestJSON-1867841191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:35:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-6724796f-d230-4e87-9b7a-7e2e37bcb273 req-10740828-b1f7-4585-a4bf-ab75c2fa46c4 tempest-DeleteServersTestJSON-1867841191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-8db5fb55-fda8-418a-9091-7e260d9e11c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55908474-0c99-4039-a176-ec083404dfd5', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:35:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-6724796f-d230-4e87-9b7a-7e2e37bcb273 req-10740828-b1f7-4585-a4bf-ab75c2fa46c4 tempest-DeleteServersTestJSON-1867841191 None] attachment_update completed successfully. Jul 19 17:35:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Acquiring lock "cinder-2792b9ab-7974-421f-ba2b-19243552ffcf-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:35:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Lock "cinder-2792b9ab-7974-421f-ba2b-19243552ffcf-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:35:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Acquiring lock "cinder-quobyte-2792b9ab-7974-421f-ba2b-19243552ffcf" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:35:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Lock "cinder-quobyte-2792b9ab-7974-421f-ba2b-19243552ffcf" acquired by "delete_volume" :: waited 0.111s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:35:33 devstack cinder-volume[87676]: INFO oslo.privsep.daemon [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7sl6zkif/privsep.sock'] Jul 19 17:35:33 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7sl6zkif/privsep.sock Jul 19 17:35:33 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:35:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:35:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:35:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:35:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:35:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:35:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:35:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:35:34 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:35:34 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:35:36 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Jul 19 17:35:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 1.365s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:35:36 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:35:36 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:35:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 7 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:35:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:35:36 devstack cinder-volume[87676]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 19 17:35:36 devstack cinder-volume[87676]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 19 17:35:36 devstack cinder-volume[87676]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 19 17:35:36 devstack cinder-volume[87676]: WARNING oslo.privsep.daemon [-] privsep log: Jul 19 17:35:36 devstack cinder-volume[87676]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 19 17:35:36 devstack cinder-volume[87676]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 19 17:35:36 devstack cinder-volume[87676]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 19 17:35:36 devstack cinder-volume[87676]: WARNING oslo.privsep.daemon [-] privsep log: Jul 19 17:35:36 devstack cinder-volume[87676]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 19 17:35:37 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Jul 19 17:35:37 devstack cinder-volume[87676]: INFO oslo.privsep.daemon [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Spawned new privsep daemon via rootwrap Jul 19 17:35:37 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Accepted privsep connection to /tmp/tmp7sl6zkif/privsep.sock {{(pid=87676) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 19 17:35:37 devstack cinder-volume[87676]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 19 17:35:37 devstack cinder-volume[87676]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 19 17:35:37 devstack cinder-volume[87676]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 19 17:35:37 devstack cinder-volume[87676]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89278 Jul 19 17:35:37 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c972c9-9e3a-4b03-a1e4-badb83d1d35c]: (2,) {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:35:37 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc2c358-599b-457d-858f-a1e0a76c5358]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:35:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2792b9ab-7974-421f-ba2b-19243552ffcf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:35:38 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2792b9ab-7974-421f-ba2b-19243552ffcf Jul 19 17:35:38 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:35:38 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Jul 19 17:35:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2792b9ab-7974-421f-ba2b-19243552ffcf" returned: 0 in 0.715s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:35:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2792b9ab-7974-421f-ba2b-19243552ffcf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:35:38 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2792b9ab-7974-421f-ba2b-19243552ffcf Jul 19 17:35:38 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:35:39 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Jul 19 17:35:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2792b9ab-7974-421f-ba2b-19243552ffcf" returned: 0 in 0.643s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:35:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Lock "cinder-quobyte-2792b9ab-7974-421f-ba2b-19243552ffcf" released by "delete_volume" :: held 5.265s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:35:39 devstack cinder-volume[87676]: WARNING cinder.quota [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:35:39 devstack cinder-volume[87676]: WARNING cinder.quota [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:35:39 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Created reservations ['06eaa3a2-06df-409b-9b57-e048be08dbb5', '34e4d28f-4d43-490c-a2b0-749cc151dca5', 'adfb81f7-ed21-4f3c-b49b-d0c3e3df9218', '828e6e5e-5096-4037-ae10-f906b02e35e5'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:35:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:35:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:35:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:35:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:35:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:35:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:35:39 devstack sudo[89422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:35:39 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:35:40 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root Jul 19 17:35:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.577s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:35:40 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:35:40 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Deleted volume successfully. Jul 19 17:35:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1bb4e012-ea75-41c8-94fe-839ff4f1c884 tempest-VolumesAdminNegativeTest-236600902 None] Lock "cinder-2792b9ab-7974-421f-ba2b-19243552ffcf-delete_volume" released by "delete_volume" :: held 6.800s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:35:41 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-d83a05af-c452-4108-adb2-983504cbc7e3 req-83ca39d3-c8f9-4ea4-b9ec-0d5f3c07a5ee tempest-DeleteServersTestJSON-1867841191 None] Terminate volume connection completed successfully. Jul 19 17:35:41 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-d83a05af-c452-4108-adb2-983504cbc7e3 req-83ca39d3-c8f9-4ea4-b9ec-0d5f3c07a5ee tempest-DeleteServersTestJSON-1867841191 None] Deleting attachment 55908474-0c99-4039-a176-ec083404dfd5. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:35:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Acquiring lock "cinder-8db5fb55-fda8-418a-9091-7e260d9e11c6-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:35:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Lock "cinder-8db5fb55-fda8-418a-9091-7e260d9e11c6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:35:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Acquiring lock "cinder-quobyte-8db5fb55-fda8-418a-9091-7e260d9e11c6" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:35:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Lock "cinder-quobyte-8db5fb55-fda8-418a-9091-7e260d9e11c6" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:35:44 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecf3f58-228e-4c13-aa30-def2f7bf0d5c]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:35:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8db5fb55-fda8-418a-9091-7e260d9e11c6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:35:44 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8db5fb55-fda8-418a-9091-7e260d9e11c6 Jul 19 17:35:44 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:35:44 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Jul 19 17:35:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8db5fb55-fda8-418a-9091-7e260d9e11c6" returned: 0 in 0.395s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:35:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8db5fb55-fda8-418a-9091-7e260d9e11c6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:35:44 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8db5fb55-fda8-418a-9091-7e260d9e11c6 Jul 19 17:35:44 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:35:44 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Jul 19 17:35:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8db5fb55-fda8-418a-9091-7e260d9e11c6" returned: 0 in 0.399s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:35:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Lock "cinder-quobyte-8db5fb55-fda8-418a-9091-7e260d9e11c6" released by "delete_volume" :: held 0.898s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:35:45 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Created reservations ['bdb49d3a-bc6f-4dd8-99df-70cda227b3da', '1dc2e85d-9be4-44b5-81b4-ac573c25a393', '67a09711-2c15-4464-af29-29658ff05390', '4c8c27ab-4474-460e-a646-eefea42f79a0'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:35:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:35:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:35:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:35:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:35:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:35:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:35:45 devstack sudo[89485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:35:45 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:35:45 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root Jul 19 17:35:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.369s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:35:45 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:35:45 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Deleted volume successfully. Jul 19 17:35:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a29ec65f-ba05-4418-bb31-115af127dda0 tempest-DeleteServersTestJSON-1867841191 None] Lock "cinder-8db5fb55-fda8-418a-9091-7e260d9e11c6-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:35:55 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:UPDATE=20,cinder:SELECT=18,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:35:55 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=25,cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Flow 'volume_create_manager' (1a4ab31a-7593-4c4e-8bfd-94aa07952dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784d7339-6d89-4690-ab34-dda5fcc3e816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784d7339-6d89-4690-ab34-dda5fcc3e816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1866965386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179de56a-3702-450b-9810-3fe2ecd0eca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dec4ee6a7b74134830bec3462d19779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:35:57Z,use_quota=True,user_id='b3babb979ce24af2b41e13c2cbf0b18b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad97389c-7f48-4cb7-888b-48e5c3fedf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad97389c-7f48-4cb7-888b-48e5c3fedf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d9a620-a97e-4c42-a16b-862902751801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d9a620-a97e-4c42-a16b-862902751801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '179de56a-3702-450b-9810-3fe2ecd0eca5', 'volume_name': 'volume-179de56a-3702-450b-9810-3fe2ecd0eca5', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa5198d-d8b5-44aa-a4cc-53d9508bdfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa5198d-d8b5-44aa-a4cc-53d9508bdfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09207a83-e2d7-4783-85b9-f791f07f5e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:57 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Volume 179de56a-3702-450b-9810-3fe2ecd0eca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-179de56a-3702-450b-9810-3fe2ecd0eca5', 'volume_size': 1} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1866965386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179de56a-3702-450b-9810-3fe2ecd0eca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dec4ee6a7b74134830bec3462d19779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:35:57Z,use_quota=True,user_id='b3babb979ce24af2b41e13c2cbf0b18b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Creating volume 179de56a-3702-450b-9810-3fe2ecd0eca5 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:35:57 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:35:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-179de56a-3702-450b-9810-3fe2ecd0eca5 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:35:57 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-179de56a-3702-450b-9810-3fe2ecd0eca5 1073741824 Jul 19 17:35:57 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:35:58 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Jul 19 17:35:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-179de56a-3702-450b-9810-3fe2ecd0eca5 1073741824" returned: 0 in 0.614s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:35:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-179de56a-3702-450b-9810-3fe2ecd0eca5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:35:58 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-179de56a-3702-450b-9810-3fe2ecd0eca5 Jul 19 17:35:58 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:35:58 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Jul 19 17:35:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-179de56a-3702-450b-9810-3fe2ecd0eca5" returned: 0 in 0.305s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:35:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:35:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:35:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09207a83-e2d7-4783-85b9-f791f07f5e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-179de56a-3702-450b-9810-3fe2ecd0eca5', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be7e9d5-08a8-4e00-89cd-64456fdacff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:35:58 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Volume volume-179de56a-3702-450b-9810-3fe2ecd0eca5 (179de56a-3702-450b-9810-3fe2ecd0eca5): created successfully Jul 19 17:35:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be7e9d5-08a8-4e00-89cd-64456fdacff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:35:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Flow 'volume_create_manager' (1a4ab31a-7593-4c4e-8bfd-94aa07952dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:35:58 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-72a8c06b-17c4-436c-b81b-a72e7a30c006 tempest-ServersNegativeTestJSON-1710723176 None] Created volume successfully. Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Flow 'volume_create_manager' (e8abc2dd-fc8c-437c-ae8a-fb608fd3de76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc1fcbf-9551-4f3f-abb3-37a372145bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc1fcbf-9551-4f3f-abb3-37a372145bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1108356730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ddf1141-7815-49d3-9d87-8f2475abc4e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dec4ee6a7b74134830bec3462d19779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:36:05Z,use_quota=True,user_id='b3babb979ce24af2b41e13c2cbf0b18b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44277f52-434b-492d-9eac-80b64e2d66fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44277f52-434b-492d-9eac-80b64e2d66fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b802c68-82be-4f26-a345-3f863c7ba985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b802c68-82be-4f26-a345-3f863c7ba985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ddf1141-7815-49d3-9d87-8f2475abc4e3', 'volume_name': 'volume-6ddf1141-7815-49d3-9d87-8f2475abc4e3', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce847d5d-23a8-42ae-a33e-9de73e1b1f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce847d5d-23a8-42ae-a33e-9de73e1b1f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f25f03-d721-4375-929f-46a64fe02152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:04 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Volume 6ddf1141-7815-49d3-9d87-8f2475abc4e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ddf1141-7815-49d3-9d87-8f2475abc4e3', 'volume_size': 1} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1108356730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ddf1141-7815-49d3-9d87-8f2475abc4e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dec4ee6a7b74134830bec3462d19779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:36:05Z,use_quota=True,user_id='b3babb979ce24af2b41e13c2cbf0b18b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Creating volume 6ddf1141-7815-49d3-9d87-8f2475abc4e3 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:36:04 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:36:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6ddf1141-7815-49d3-9d87-8f2475abc4e3 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:36:04 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6ddf1141-7815-49d3-9d87-8f2475abc4e3 1073741824 Jul 19 17:36:04 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:36:05 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Jul 19 17:36:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6ddf1141-7815-49d3-9d87-8f2475abc4e3 1073741824" returned: 0 in 0.653s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:36:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6ddf1141-7815-49d3-9d87-8f2475abc4e3 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:36:05 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6ddf1141-7815-49d3-9d87-8f2475abc4e3 Jul 19 17:36:05 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:36:06 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Jul 19 17:36:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6ddf1141-7815-49d3-9d87-8f2475abc4e3" returned: 0 in 0.390s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:36:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:36:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:36:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f25f03-d721-4375-929f-46a64fe02152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ddf1141-7815-49d3-9d87-8f2475abc4e3', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fe00c1-2906-4bd0-bc22-e8c19986c66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:06 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Volume volume-6ddf1141-7815-49d3-9d87-8f2475abc4e3 (6ddf1141-7815-49d3-9d87-8f2475abc4e3): created successfully Jul 19 17:36:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fe00c1-2906-4bd0-bc22-e8c19986c66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Flow 'volume_create_manager' (e8abc2dd-fc8c-437c-ae8a-fb608fd3de76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:36:06 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-6fcc179c-eb97-4113-8461-ab112786f977 tempest-ServersNegativeTestJSON-1710723176 None] Created volume successfully. Jul 19 17:36:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Acquiring lock "cinder-6ddf1141-7815-49d3-9d87-8f2475abc4e3-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:36:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Lock "cinder-6ddf1141-7815-49d3-9d87-8f2475abc4e3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:36:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Acquiring lock "cinder-quobyte-6ddf1141-7815-49d3-9d87-8f2475abc4e3" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:36:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Lock "cinder-quobyte-6ddf1141-7815-49d3-9d87-8f2475abc4e3" acquired by "delete_volume" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:36:09 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c458d3d-b8af-4285-b449-370ff4febaed]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:36:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6ddf1141-7815-49d3-9d87-8f2475abc4e3 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:36:09 devstack sudo[89567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6ddf1141-7815-49d3-9d87-8f2475abc4e3 Jul 19 17:36:09 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:36:09 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root Jul 19 17:36:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6ddf1141-7815-49d3-9d87-8f2475abc4e3" returned: 0 in 0.603s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:36:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6ddf1141-7815-49d3-9d87-8f2475abc4e3 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:36:09 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6ddf1141-7815-49d3-9d87-8f2475abc4e3 Jul 19 17:36:09 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:36:10 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Jul 19 17:36:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6ddf1141-7815-49d3-9d87-8f2475abc4e3" returned: 0 in 0.415s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:36:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Lock "cinder-quobyte-6ddf1141-7815-49d3-9d87-8f2475abc4e3" released by "delete_volume" :: held 1.081s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:36:10 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Created reservations ['1560b25a-b261-42e4-988c-a7398a7bc2bc', '90b5def6-74fc-4e01-a641-1ac6d23471b5', '41fb0da8-f2da-4d03-9a66-a69ad3ec2757', 'cc0ef6d9-dbb5-41f5-bcc6-5d2a64d059a7'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:36:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:36:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:36:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:36:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:36:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:36:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:36:10 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:36:10 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:36:10 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Jul 19 17:36:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.322s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:36:10 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:36:10 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Deleted volume successfully. Jul 19 17:36:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce67b2be-b972-4eae-8684-7d3868bce090 tempest-ServersNegativeTestJSON-1710723176 None] Lock "cinder-6ddf1141-7815-49d3-9d87-8f2475abc4e3-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:36:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Acquiring lock "cinder-179de56a-3702-450b-9810-3fe2ecd0eca5-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:36:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Lock "cinder-179de56a-3702-450b-9810-3fe2ecd0eca5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:36:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Acquiring lock "cinder-quobyte-179de56a-3702-450b-9810-3fe2ecd0eca5" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:36:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Lock "cinder-quobyte-179de56a-3702-450b-9810-3fe2ecd0eca5" acquired by "delete_volume" :: waited 0.042s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:36:11 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b68a678-586a-485e-be03-c66a246d6553]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:36:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-179de56a-3702-450b-9810-3fe2ecd0eca5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:36:11 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-179de56a-3702-450b-9810-3fe2ecd0eca5 Jul 19 17:36:11 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:36:12 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Jul 19 17:36:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-179de56a-3702-450b-9810-3fe2ecd0eca5" returned: 0 in 0.582s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:36:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-179de56a-3702-450b-9810-3fe2ecd0eca5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:36:12 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-179de56a-3702-450b-9810-3fe2ecd0eca5 Jul 19 17:36:12 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:36:12 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Jul 19 17:36:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-179de56a-3702-450b-9810-3fe2ecd0eca5" returned: 0 in 0.428s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:36:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Lock "cinder-quobyte-179de56a-3702-450b-9810-3fe2ecd0eca5" released by "delete_volume" :: held 1.093s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:36:12 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Created reservations ['b174a990-6578-44e7-a48d-620b0b913255', 'eac5c535-2139-4e8b-815e-634812ee63a4', 'd5888b71-a92d-475d-85d4-20f418f9ece5', 'eedea7a0-d722-4f7f-8a31-10944d957bd7'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:36:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:36:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:36:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:36:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:36:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:36:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:36:12 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:36:12 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:36:13 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Jul 19 17:36:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.335s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:36:13 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:36:13 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Deleted volume successfully. Jul 19 17:36:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6f433326-1c75-41d2-b090-6962e7a6b6f0 tempest-ServersNegativeTestJSON-1710723176 None] Lock "cinder-179de56a-3702-450b-9810-3fe2ecd0eca5-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:36:22 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=12,cinder:INSERT=5,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:36:23 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=17,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=5 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Flow 'volume_create_manager' (0a2c63c4-c051-4af8-a192-32f257c24ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d70bd13-51be-4a3d-a671-92717f3cd886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d70bd13-51be-4a3d-a671-92717f3cd886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2075038702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4453f13f-7604-4d99-ad92-31a4c993cfa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a04726ef6246039f125bfc39ed5cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:36:35Z,use_quota=True,user_id='acb945fa061b4d318b5e4e45d8d21ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8779f780-563b-4120-ba6f-09355a6d62c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8779f780-563b-4120-ba6f-09355a6d62c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72800479-9fb7-43c2-91f7-59fe5a7fb942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72800479-9fb7-43c2-91f7-59fe5a7fb942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4453f13f-7604-4d99-ad92-31a4c993cfa3', 'volume_name': 'volume-4453f13f-7604-4d99-ad92-31a4c993cfa3', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2800d7c-fae6-4818-8c8f-fdbc69b4c863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2800d7c-fae6-4818-8c8f-fdbc69b4c863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed63a307-c5c2-42ca-a665-4f35b532c5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:34 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Volume 4453f13f-7604-4d99-ad92-31a4c993cfa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4453f13f-7604-4d99-ad92-31a4c993cfa3', 'volume_size': 1} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2075038702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4453f13f-7604-4d99-ad92-31a4c993cfa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a04726ef6246039f125bfc39ed5cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:36:35Z,use_quota=True,user_id='acb945fa061b4d318b5e4e45d8d21ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Creating volume 4453f13f-7604-4d99-ad92-31a4c993cfa3 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:36:34 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4453f13f-7604-4d99-ad92-31a4c993cfa3 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:36:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:36:34 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4453f13f-7604-4d99-ad92-31a4c993cfa3 1073741824 Jul 19 17:36:34 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:36:34 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:36:34 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:36:35 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Jul 19 17:36:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.632s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:36:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:36:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:36:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 8 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:36:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:36:35 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Jul 19 17:36:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4453f13f-7604-4d99-ad92-31a4c993cfa3 1073741824" returned: 0 in 0.875s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:36:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4453f13f-7604-4d99-ad92-31a4c993cfa3 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:36:35 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4453f13f-7604-4d99-ad92-31a4c993cfa3 Jul 19 17:36:35 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:36:36 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Jul 19 17:36:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4453f13f-7604-4d99-ad92-31a4c993cfa3" returned: 0 in 0.384s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:36:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:36:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:36:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed63a307-c5c2-42ca-a665-4f35b532c5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4453f13f-7604-4d99-ad92-31a4c993cfa3', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6949cd87-bda8-41c8-8f0a-84ec1e28b56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:36 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Volume volume-4453f13f-7604-4d99-ad92-31a4c993cfa3 (4453f13f-7604-4d99-ad92-31a4c993cfa3): created successfully Jul 19 17:36:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6949cd87-bda8-41c8-8f0a-84ec1e28b56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Flow 'volume_create_manager' (0a2c63c4-c051-4af8-a192-32f257c24ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:36:36 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-00bc9a21-a32c-4f47-bbab-f40e149ef48d tempest-TaggedAttachmentsTest-947701082 None] Created volume successfully. Jul 19 17:36:46 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:36:46 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Flow 'volume_create_manager' (6fe659ed-a404-4ec8-9a7d-2f32b0cc44c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14fc35e2-4095-42a1-ae61-a142c522238d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14fc35e2-4095-42a1-ae61-a142c522238d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-197540957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d101fb5-eae0-47b8-bab1-9c36d51dea25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59f4c80f89ff44279f3920ad82dcd495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:36:56Z,use_quota=True,user_id='f9b3aa5448004e55ac8001e53bdea796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482893fb-8058-48ac-b244-2f33bd53aac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482893fb-8058-48ac-b244-2f33bd53aac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb13c144-f151-41dd-b319-c5ffc2bf3fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb13c144-f151-41dd-b319-c5ffc2bf3fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d101fb5-eae0-47b8-bab1-9c36d51dea25', 'volume_name': 'volume-6d101fb5-eae0-47b8-bab1-9c36d51dea25', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd0a967-9c5f-43f1-9b50-623b37f622e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd0a967-9c5f-43f1-9b50-623b37f622e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8da980-1147-44b3-84d5-9cb5a5802051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:56 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Volume 6d101fb5-eae0-47b8-bab1-9c36d51dea25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d101fb5-eae0-47b8-bab1-9c36d51dea25', 'volume_size': 1} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-197540957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d101fb5-eae0-47b8-bab1-9c36d51dea25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59f4c80f89ff44279f3920ad82dcd495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:36:56Z,use_quota=True,user_id='f9b3aa5448004e55ac8001e53bdea796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Creating volume 6d101fb5-eae0-47b8-bab1-9c36d51dea25 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:36:56 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:36:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6d101fb5-eae0-47b8-bab1-9c36d51dea25 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:36:56 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6d101fb5-eae0-47b8-bab1-9c36d51dea25 1073741824 Jul 19 17:36:56 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:36:57 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Jul 19 17:36:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6d101fb5-eae0-47b8-bab1-9c36d51dea25 1073741824" returned: 0 in 0.858s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:36:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6d101fb5-eae0-47b8-bab1-9c36d51dea25 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:36:57 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6d101fb5-eae0-47b8-bab1-9c36d51dea25 Jul 19 17:36:57 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:36:57 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Jul 19 17:36:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6d101fb5-eae0-47b8-bab1-9c36d51dea25" returned: 0 in 0.572s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:36:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:36:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:36:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8da980-1147-44b3-84d5-9cb5a5802051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d101fb5-eae0-47b8-bab1-9c36d51dea25', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fccc376b-8152-472c-9ba4-ca36a1b0dd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:36:57 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Volume volume-6d101fb5-eae0-47b8-bab1-9c36d51dea25 (6d101fb5-eae0-47b8-bab1-9c36d51dea25): created successfully Jul 19 17:36:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fccc376b-8152-472c-9ba4-ca36a1b0dd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:36:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Flow 'volume_create_manager' (6fe659ed-a404-4ec8-9a7d-2f32b0cc44c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:36:57 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-2976ef98-4ffc-41f6-b3cc-fc843296856b tempest-AttachVolumeShelveTestJSON-667507781 None] Created volume successfully. Jul 19 17:37:07 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:37:07 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:37:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-d991352e-e7e0-4cbb-84cd-138f37d01aac req-944c570d-002c-4ee1-a2ff-d7891e076853 tempest-AttachVolumeShelveTestJSON-667507781 None] No connector for attachment 773db25e-60d4-4be5-8abd-97f72d601471; skipping storage backend terminate_connection call. {{(pid=87676) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 19 17:37:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-d991352e-e7e0-4cbb-84cd-138f37d01aac req-944c570d-002c-4ee1-a2ff-d7891e076853 tempest-AttachVolumeShelveTestJSON-667507781 None] Deleting attachment 773db25e-60d4-4be5-8abd-97f72d601471. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Flow 'volume_create_manager' (b7881843-6b80-4f43-9818-922bf69a0c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2b5dfe-733c-449c-9459-1aff04cb6449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2b5dfe-733c-449c-9459-1aff04cb6449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-171926612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98436419-665f-438b-b5db-f52d14a294fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a2fee7492f94655a7a64df4ed9256ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:37:16Z,use_quota=True,user_id='858a6fc4abbf44b3a923852de19787bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1de7f86-ea17-4015-9dc4-e75dcbbd2623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1de7f86-ea17-4015-9dc4-e75dcbbd2623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d708f68b-12c5-4c41-a4a6-3743dc0d406d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d708f68b-12c5-4c41-a4a6-3743dc0d406d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98436419-665f-438b-b5db-f52d14a294fd', 'volume_name': 'volume-98436419-665f-438b-b5db-f52d14a294fd', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec777e13-a983-444d-956d-346a7150a203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec777e13-a983-444d-956d-346a7150a203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5eee37-6be4-435e-8766-c4840c5e0389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:37:16 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Volume 98436419-665f-438b-b5db-f52d14a294fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98436419-665f-438b-b5db-f52d14a294fd', 'volume_size': 1} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-171926612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98436419-665f-438b-b5db-f52d14a294fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a2fee7492f94655a7a64df4ed9256ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:37:16Z,use_quota=True,user_id='858a6fc4abbf44b3a923852de19787bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Creating volume 98436419-665f-438b-b5db-f52d14a294fd {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:37:16 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-98436419-665f-438b-b5db-f52d14a294fd 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:37:16 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-98436419-665f-438b-b5db-f52d14a294fd 1073741824 Jul 19 17:37:16 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:37:16 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-98436419-665f-438b-b5db-f52d14a294fd 1073741824" returned: 0 in 0.632s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:37:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-98436419-665f-438b-b5db-f52d14a294fd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:37:16 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-98436419-665f-438b-b5db-f52d14a294fd Jul 19 17:37:16 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:37:17 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Jul 19 17:37:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-98436419-665f-438b-b5db-f52d14a294fd" returned: 0 in 0.284s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:37:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:37:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:37:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5eee37-6be4-435e-8766-c4840c5e0389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98436419-665f-438b-b5db-f52d14a294fd', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:37:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220e8356-8332-4985-b84e-95d65905730d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:37:17 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Volume volume-98436419-665f-438b-b5db-f52d14a294fd (98436419-665f-438b-b5db-f52d14a294fd): created successfully Jul 19 17:37:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220e8356-8332-4985-b84e-95d65905730d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:37:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Flow 'volume_create_manager' (b7881843-6b80-4f43-9818-922bf69a0c49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:37:17 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-710618e3-5da1-494e-8221-74517d8288b0 tempest-ServerActionsTestOtherA-385325392 None] Created volume successfully. Jul 19 17:37:27 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:37:27 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:37:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-06c63314-2bb8-4d68-850b-b2d61ae128ac req-b304f9d4-3e20-44e1-9247-b143f45d7827 tempest-TaggedAttachmentsTest-947701082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:37:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-06c63314-2bb8-4d68-850b-b2d61ae128ac req-b304f9d4-3e20-44e1-9247-b143f45d7827 tempest-TaggedAttachmentsTest-947701082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:37:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-06c63314-2bb8-4d68-850b-b2d61ae128ac req-b304f9d4-3e20-44e1-9247-b143f45d7827 tempest-TaggedAttachmentsTest-947701082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:37:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-06c63314-2bb8-4d68-850b-b2d61ae128ac req-b304f9d4-3e20-44e1-9247-b143f45d7827 tempest-TaggedAttachmentsTest-947701082 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-4453f13f-7604-4d99-ad92-31a4c993cfa3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8942d395-aea0-4ac0-887e-7f230aa068ac', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:37:29 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-06c63314-2bb8-4d68-850b-b2d61ae128ac req-b304f9d4-3e20-44e1-9247-b143f45d7827 tempest-TaggedAttachmentsTest-947701082 None] attachment_update completed successfully. Jul 19 17:37:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-3bc9f920-8e0c-4ff8-a494-95c1521e571e req-e1835bf3-0b9d-41f1-a3b0-86697e7595d6 tempest-TaggedAttachmentsTest-947701082 None] Terminate volume connection completed successfully. Jul 19 17:37:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-3bc9f920-8e0c-4ff8-a494-95c1521e571e req-e1835bf3-0b9d-41f1-a3b0-86697e7595d6 tempest-TaggedAttachmentsTest-947701082 None] Deleting attachment 8942d395-aea0-4ac0-887e-7f230aa068ac. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Flow 'volume_create_manager' (ae71d950-0c33-4803-b646-abfa9fa26f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9664e6a1-c118-459a-985f-62bd50602144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9664e6a1-c118-459a-985f-62bd50602144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1826121808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefaea28-aad0-4e85-90c5-16024fe6d600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a870cb79ff347d09eba7e9c73bf9873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:37:33Z,use_quota=True,user_id='10ed18fa19fd44bc9a8b313e97f08343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056ce0a5-e8be-4f57-ab9a-633e38cd79c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056ce0a5-e8be-4f57-ab9a-633e38cd79c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65e7009-f26a-4d6b-866f-5ecdcb7ff181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65e7009-f26a-4d6b-866f-5ecdcb7ff181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eefaea28-aad0-4e85-90c5-16024fe6d600', 'volume_name': 'volume-eefaea28-aad0-4e85-90c5-16024fe6d600', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e2bced-428b-4cb1-80ea-16db6c51594b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e2bced-428b-4cb1-80ea-16db6c51594b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7140a828-0e00-4b18-ac64-95e19d6896e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:37:33 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Volume eefaea28-aad0-4e85-90c5-16024fe6d600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eefaea28-aad0-4e85-90c5-16024fe6d600', 'volume_size': 1} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1826121808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefaea28-aad0-4e85-90c5-16024fe6d600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a870cb79ff347d09eba7e9c73bf9873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:37:33Z,use_quota=True,user_id='10ed18fa19fd44bc9a8b313e97f08343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Creating volume eefaea28-aad0-4e85-90c5-16024fe6d600 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:37:33 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:37:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eefaea28-aad0-4e85-90c5-16024fe6d600 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:37:33 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eefaea28-aad0-4e85-90c5-16024fe6d600 1073741824 Jul 19 17:37:33 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:37:34 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Jul 19 17:37:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eefaea28-aad0-4e85-90c5-16024fe6d600 1073741824" returned: 0 in 1.188s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:37:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eefaea28-aad0-4e85-90c5-16024fe6d600 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:37:34 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eefaea28-aad0-4e85-90c5-16024fe6d600 Jul 19 17:37:34 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:37:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:37:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:37:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:37:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:37:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:37:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:37:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:37:34 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:37:34 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:37:35 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Jul 19 17:37:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eefaea28-aad0-4e85-90c5-16024fe6d600" returned: 0 in 0.672s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:37:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:37:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:37:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7140a828-0e00-4b18-ac64-95e19d6896e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eefaea28-aad0-4e85-90c5-16024fe6d600', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:37:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559bea08-9204-4668-8758-1655e469d696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:37:35 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Volume volume-eefaea28-aad0-4e85-90c5-16024fe6d600 (eefaea28-aad0-4e85-90c5-16024fe6d600): created successfully Jul 19 17:37:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559bea08-9204-4668-8758-1655e469d696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:37:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Flow 'volume_create_manager' (ae71d950-0c33-4803-b646-abfa9fa26f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:37:35 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-53bdf3ad-5417-4722-bec5-64189e2d613d tempest-AttachVolumeNegativeTest-224058568 None] Created volume successfully. Jul 19 17:37:35 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Jul 19 17:37:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.700s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:37:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:37:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:37:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 8 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:37:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:37:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-bffb82b7-ab01-4a16-ba17-ddf6cb1b2684 req-196d5361-d7f7-4c95-88c3-0e0aa907565e tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:37:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-bffb82b7-ab01-4a16-ba17-ddf6cb1b2684 req-196d5361-d7f7-4c95-88c3-0e0aa907565e tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:37:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-bffb82b7-ab01-4a16-ba17-ddf6cb1b2684 req-196d5361-d7f7-4c95-88c3-0e0aa907565e tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:37:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-bffb82b7-ab01-4a16-ba17-ddf6cb1b2684 req-196d5361-d7f7-4c95-88c3-0e0aa907565e tempest-AttachVolumeNegativeTest-224058568 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-eefaea28-aad0-4e85-90c5-16024fe6d600', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f6d682d-97c0-4d88-952e-1bd1465925cf', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:37:38 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-bffb82b7-ab01-4a16-ba17-ddf6cb1b2684 req-196d5361-d7f7-4c95-88c3-0e0aa907565e tempest-AttachVolumeNegativeTest-224058568 None] attachment_update completed successfully. Jul 19 17:37:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Acquiring lock "cinder-4453f13f-7604-4d99-ad92-31a4c993cfa3-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:37:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Lock "cinder-4453f13f-7604-4d99-ad92-31a4c993cfa3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:37:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Acquiring lock "cinder-quobyte-4453f13f-7604-4d99-ad92-31a4c993cfa3" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:37:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Lock "cinder-quobyte-4453f13f-7604-4d99-ad92-31a4c993cfa3" acquired by "delete_volume" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:37:46 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3c328e-19c6-4a04-8815-5b60c96575e8]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:37:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4453f13f-7604-4d99-ad92-31a4c993cfa3 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:37:46 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4453f13f-7604-4d99-ad92-31a4c993cfa3 Jul 19 17:37:46 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:37:46 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Jul 19 17:37:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4453f13f-7604-4d99-ad92-31a4c993cfa3" returned: 0 in 0.426s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:37:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4453f13f-7604-4d99-ad92-31a4c993cfa3 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:37:46 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4453f13f-7604-4d99-ad92-31a4c993cfa3 Jul 19 17:37:46 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:37:46 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Jul 19 17:37:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4453f13f-7604-4d99-ad92-31a4c993cfa3" returned: 0 in 0.269s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:37:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Lock "cinder-quobyte-4453f13f-7604-4d99-ad92-31a4c993cfa3" released by "delete_volume" :: held 0.739s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:37:46 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Created reservations ['e66ca026-5930-405e-8f45-013ab842416f', '2e98010d-da73-414d-9482-e51e64976aea', 'e260a983-81f5-492a-bdcf-8928b680c6fc', '4361f8c2-3015-4f56-89d5-7bb4db83d9e3'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:37:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:37:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:37:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:37:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:37:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:37:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:37:46 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:37:46 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:37:47 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Jul 19 17:37:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.397s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:37:47 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:37:47 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Deleted volume successfully. Jul 19 17:37:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0a96183c-9898-4448-9325-cb60524dcbbd tempest-TaggedAttachmentsTest-947701082 None] Lock "cinder-4453f13f-7604-4d99-ad92-31a4c993cfa3-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:37:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Acquiring lock "cinder-6d101fb5-eae0-47b8-bab1-9c36d51dea25-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:37:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Lock "cinder-6d101fb5-eae0-47b8-bab1-9c36d51dea25-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:37:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Acquiring lock "cinder-quobyte-6d101fb5-eae0-47b8-bab1-9c36d51dea25" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:37:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Lock "cinder-quobyte-6d101fb5-eae0-47b8-bab1-9c36d51dea25" acquired by "delete_volume" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:37:56 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[121d2faa-90df-4792-aefc-859e5982eb98]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:37:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6d101fb5-eae0-47b8-bab1-9c36d51dea25 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:37:56 devstack sudo[91591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6d101fb5-eae0-47b8-bab1-9c36d51dea25 Jul 19 17:37:56 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:37:56 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root Jul 19 17:37:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6d101fb5-eae0-47b8-bab1-9c36d51dea25" returned: 0 in 0.366s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:37:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6d101fb5-eae0-47b8-bab1-9c36d51dea25 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:37:56 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6d101fb5-eae0-47b8-bab1-9c36d51dea25 Jul 19 17:37:56 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:37:57 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Jul 19 17:37:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6d101fb5-eae0-47b8-bab1-9c36d51dea25" returned: 0 in 0.244s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:37:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Lock "cinder-quobyte-6d101fb5-eae0-47b8-bab1-9c36d51dea25" released by "delete_volume" :: held 0.667s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:37:57 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Created reservations ['e0e78ac4-4319-41e8-b10d-693fecd80488', '58e048ed-6dd0-4880-a998-b49891ba7147', '67f5d67e-b459-4684-ab71-210e7b5d1562', '83f37c9d-b354-4a4a-ace6-1fd1ade78463'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:37:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:37:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:37:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:37:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:37:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:37:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:37:57 devstack sudo[91600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:37:57 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:37:57 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root Jul 19 17:37:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.461s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:37:57 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:37:57 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Deleted volume successfully. Jul 19 17:37:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8dee82ae-dec2-444c-af5d-dd4166a9bd0a tempest-AttachVolumeShelveTestJSON-667507781 None] Lock "cinder-6d101fb5-eae0-47b8-bab1-9c36d51dea25-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:38:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-8ee16d3c-571d-413a-8f77-8d298ea76b53 req-09c897f4-00b1-4815-a79c-1b05065d8fae tempest-ServerActionsTestOtherA-385325392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-8ee16d3c-571d-413a-8f77-8d298ea76b53 req-09c897f4-00b1-4815-a79c-1b05065d8fae tempest-ServerActionsTestOtherA-385325392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-8ee16d3c-571d-413a-8f77-8d298ea76b53 req-09c897f4-00b1-4815-a79c-1b05065d8fae tempest-ServerActionsTestOtherA-385325392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-8ee16d3c-571d-413a-8f77-8d298ea76b53 req-09c897f4-00b1-4815-a79c-1b05065d8fae tempest-ServerActionsTestOtherA-385325392 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-98436419-665f-438b-b5db-f52d14a294fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1011c1c6-7a76-48fe-be2a-6ae64ebc112b', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:38:00 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-8ee16d3c-571d-413a-8f77-8d298ea76b53 req-09c897f4-00b1-4815-a79c-1b05065d8fae tempest-ServerActionsTestOtherA-385325392 None] attachment_update completed successfully. Jul 19 17:38:04 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-5a77f9db-0b45-492a-a8aa-093f4ecf5739 req-6aae2b2b-bde3-4ff0-a9b2-4a388c494ab4 tempest-ServerActionsTestOtherA-385325392 None] Terminate volume connection completed successfully. Jul 19 17:38:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-5a77f9db-0b45-492a-a8aa-093f4ecf5739 req-6aae2b2b-bde3-4ff0-a9b2-4a388c494ab4 tempest-ServerActionsTestOtherA-385325392 None] Deleting attachment 1011c1c6-7a76-48fe-be2a-6ae64ebc112b. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:38:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-5a77f9db-0b45-492a-a8aa-093f4ecf5739 req-ff68fbaf-2c1b-4571-a9c7-4c19dac19ab1 tempest-ServerActionsTestOtherA-385325392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-5a77f9db-0b45-492a-a8aa-093f4ecf5739 req-ff68fbaf-2c1b-4571-a9c7-4c19dac19ab1 tempest-ServerActionsTestOtherA-385325392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-5a77f9db-0b45-492a-a8aa-093f4ecf5739 req-ff68fbaf-2c1b-4571-a9c7-4c19dac19ab1 tempest-ServerActionsTestOtherA-385325392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-5a77f9db-0b45-492a-a8aa-093f4ecf5739 req-ff68fbaf-2c1b-4571-a9c7-4c19dac19ab1 tempest-ServerActionsTestOtherA-385325392 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-98436419-665f-438b-b5db-f52d14a294fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d25ccaa-4bb8-4eba-9733-9cb6b46ee71a', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:38:06 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-5a77f9db-0b45-492a-a8aa-093f4ecf5739 req-ff68fbaf-2c1b-4571-a9c7-4c19dac19ab1 tempest-ServerActionsTestOtherA-385325392 None] attachment_update completed successfully. Jul 19 17:38:08 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-18f6d87b-45d0-406a-8889-c08093bb7e0c tempest-GroupSnapshotsTest-1283131101 None] Group tempest-GroupSnapshotsTest-Group-1817167950: creating Jul 19 17:38:08 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-18f6d87b-45d0-406a-8889-c08093bb7e0c tempest-GroupSnapshotsTest-1283131101 None] Group tempest-GroupSnapshotsTest-Group-1817167950: created successfully Jul 19 17:38:08 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-18f6d87b-45d0-406a-8889-c08093bb7e0c tempest-GroupSnapshotsTest-1283131101 None] Create group completed successfully. Jul 19 17:38:10 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:38:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Flow 'volume_create_manager' (1fc9007c-fa9a-4b15-ab63-db6bfb557edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:38:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a8016b-3250-4a6b-a117-e6cfe0623389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a8016b-3250-4a6b-a117-e6cfe0623389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-866546404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9662ad34-5340-4463-8502-68ed3d1ecfbf,host='devstack@QuobyteHD#QuobyteHD',id=037c21c0-c946-4908-a095-1ca2852ef411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d585f7dc5a479bbd9e0a2d7d07eb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:38:11Z,use_quota=True,user_id='5759b5c5926147f9b333c4c7809ec020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4be226e7-c0f6-4763-96ec-9718bc13545d),volume_type_id=4be226e7-c0f6-4763-96ec-9718bc13545d)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74321e8d-8aeb-4d6f-9048-628be5fa750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74321e8d-8aeb-4d6f-9048-628be5fa750a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fabb8b7-32e5-48d7-a030-a401628678ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fabb8b7-32e5-48d7-a030-a401628678ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '037c21c0-c946-4908-a095-1ca2852ef411', 'volume_name': 'volume-037c21c0-c946-4908-a095-1ca2852ef411', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2975a411-e4ee-4ee2-974c-1c36bc4c32c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2975a411-e4ee-4ee2-974c-1c36bc4c32c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2891580d-77cf-44f0-988e-64a392630b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:10 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Volume 037c21c0-c946-4908-a095-1ca2852ef411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-037c21c0-c946-4908-a095-1ca2852ef411', 'volume_size': 1} Jul 19 17:38:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9662ad34-5340-4463-8502-68ed3d1ecfbf,created_at=2026-07-19T15:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-866546404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9662ad34-5340-4463-8502-68ed3d1ecfbf,host='devstack@QuobyteHD#QuobyteHD',id=037c21c0-c946-4908-a095-1ca2852ef411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d585f7dc5a479bbd9e0a2d7d07eb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:38:11Z,use_quota=True,user_id='5759b5c5926147f9b333c4c7809ec020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4be226e7-c0f6-4763-96ec-9718bc13545d),volume_type_id=4be226e7-c0f6-4763-96ec-9718bc13545d)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:38:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Creating volume 037c21c0-c946-4908-a095-1ca2852ef411 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:38:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:38:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:38:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:38:11 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:38:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:11 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 1073741824 Jul 19 17:38:11 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:11 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 1073741824" returned: 0 in 0.581s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:11 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 Jul 19 17:38:11 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:12 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411" returned: 0 in 0.366s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:38:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2891580d-77cf-44f0-988e-64a392630b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-037c21c0-c946-4908-a095-1ca2852ef411', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f53ca3b-9e49-49ed-8f5e-b7fda44f2d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:12 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Volume volume-037c21c0-c946-4908-a095-1ca2852ef411 (037c21c0-c946-4908-a095-1ca2852ef411): created successfully Jul 19 17:38:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f53ca3b-9e49-49ed-8f5e-b7fda44f2d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Flow 'volume_create_manager' (1fc9007c-fa9a-4b15-ab63-db6bfb557edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:38:12 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a75951bb-6401-4569-92ea-677eebdeccba tempest-GroupSnapshotsTest-1283131101 None] Created volume successfully. Jul 19 17:38:13 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] GroupSnapshot d85cf6bc-67c2-4130-b96a-d9a642aba20a: creating. Jul 19 17:38:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] Group snapshot d85cf6bc-67c2-4130-b96a-d9a642aba20a: creating. {{(pid=87676) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 19 17:38:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] Creating offline snapshot 68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 of volume 037c21c0-c946-4908-a095-1ca2852ef411 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:38:13 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcbfd48-54db-43c1-beaf-b9fe7f9eca2b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:38:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:14 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 Jul 19 17:38:14 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:14 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411" returned: 0 in 0.550s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:14 devstack sudo[91817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 1G Jul 19 17:38:14 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:15 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 1G" returned: 0 in 0.659s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-037c21c0-c946-4908-a095-1ca2852ef411 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:15 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-037c21c0-c946-4908-a095-1ca2852ef411 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 Jul 19 17:38:15 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:15 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-037c21c0-c946-4908-a095-1ca2852ef411 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4" returned: 0 in 0.438s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:15 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 is being set with open permissions: ugo+rw: NotImplementedError Jul 19 17:38:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:15 devstack sudo[91828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 Jul 19 17:38:15 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:15 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4" returned: 0 in 0.288s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:15 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.info Jul 19 17:38:15 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:16 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.info" returned: 0 in 0.338s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:16 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.info is being set with open permissions: ugo+rw: NotImplementedError Jul 19 17:38:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:16 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.info Jul 19 17:38:16 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:16 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.info" returned: 0 in 0.465s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.875s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:16 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-86a043dd-167a-4d40-937b-d2b00d8654b7 tempest-GroupSnapshotsTest-1283131101 None] group_snapshot d85cf6bc-67c2-4130-b96a-d9a642aba20a: created successfully Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "cinder-quobyte-68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7" by "_create_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Creating volume 0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7 from snapshot 68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 {{(pid=87676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "cinder-quobyte-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7" by "_copy_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] snapshot: 68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4, volume: 0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7, {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d2f151-4ce8-4306-a968-1fc29ac0372b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:38:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:18 devstack sudo[91865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 Jul 19 17:38:18 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:19 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4" returned: 0 in 0.561s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-037c21c0-c946-4908-a095-1ca2852ef411(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:38:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] will copy from snapshot at /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 17:38:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Creating direct copy from snapshot {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 17:38:19 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f164b47-f967-4d8d-adf6-04d197bfab7f]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:38:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:19 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 Jul 19 17:38:19 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:19 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411" returned: 0 in 0.616s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:19 devstack cinder-volume[87676]: DEBUG cinder.utils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Path /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7 not found in is_blk_device check {{(pid=87676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 17:38:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:19 devstack sudo[91879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7 Jul 19 17:38:19 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:26 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-a5a3fa12-46d9-4437-9a43-74d549848ace req-1b0d449b-12a8-48b8-8a1a-4c0788b5bfbc tempest-AttachVolumeNegativeTest-224058568 None] Terminate volume connection completed successfully. Jul 19 17:38:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-a5a3fa12-46d9-4437-9a43-74d549848ace req-1b0d449b-12a8-48b8-8a1a-4c0788b5bfbc tempest-AttachVolumeNegativeTest-224058568 None] Deleting attachment 6f6d682d-97c0-4d88-952e-1bd1465925cf. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:38:26 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7" returned: 0 in 6.882s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:26 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8884a139-6e65-4728-97a2-49e075863e2d]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:38:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:26 devstack sudo[91931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 Jul 19 17:38:26 devstack sudo[91931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:27 devstack sudo[91931]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411" returned: 0 in 0.658s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:27 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Image conversion details: src /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:38:27 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Converted 1024.00 MB image at 148.76 MB/s Jul 19 17:38:27 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7 is being set with open permissions: ugo+rw: NotImplementedError Jul 19 17:38:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:27 devstack sudo[91948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7 Jul 19 17:38:27 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:27 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7" returned: 0 in 0.363s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7" released by "_copy_volume_from_snapshot" :: held 9.254s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:38:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7" released by "_create_volume_from_snapshot" :: held 9.329s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:38:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.365s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:27 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=45,cinder:UPDATE=31,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:38:27 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=62,cinder:UPDATE=34,cinder:DELETE=1,cinder:INSERT=3 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:38:28 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9b3621f5-f1fd-4d44-acdf-dfcfabb2e8ae tempest-GroupSnapshotsTest-1283131101 None] Create group from source-snapshot-d85cf6bc-67c2-4130-b96a-d9a642aba20a completed successfully. Jul 19 17:38:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "cinder-quobyte-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:38:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7" acquired by "delete_volume" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:38:29 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[500eaacb-8d1d-445a-a946-36cb1971a394]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:38:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:29 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7 Jul 19 17:38:29 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:30 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7" returned: 0 in 0.689s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:30 devstack sudo[91977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7 Jul 19 17:38:30 devstack sudo[91977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:30 devstack sudo[91977]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7" returned: 0 in 0.476s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-0fb45a3a-ba88-4cd9-abb1-e8e6ce839bf7" released by "delete_volume" :: held 1.265s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:38:30 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Created reservations ['38f64d04-1e28-41a0-be53-02d15b85facc'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:38:31 devstack cinder-volume[87676]: WARNING cinder.quota [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-199217164 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-199217164, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:38:31 devstack cinder-volume[87676]: WARNING cinder.quota [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-199217164 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-199217164, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:38:31 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Created reservations ['2eedb1c1-4193-4a80-a3fe-1e0c1f0939c5', '166f3c42-38b7-4383-bd17-02231d74a54c', 'c23493db-e1cf-4a37-93f4-ca80d570b794', '6098b4fd-bb35-4de6-aa26-00693f9f3615'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:38:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:38:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:38:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:31 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:38:31 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:31 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.454s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:31 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:38:31 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c973c24e-8fd2-4d75-8460-ffdadff70c3d tempest-GroupSnapshotsTest-1283131101 None] Delete group completed successfully. Jul 19 17:38:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] group_snapshot d85cf6bc-67c2-4130-b96a-d9a642aba20a: deleting Jul 19 17:38:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] group_snapshot d85cf6bc-67c2-4130-b96a-d9a642aba20a: deleting {{(pid=87676) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 19 17:38:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "cinder-quobyte-037c21c0-c946-4908-a095-1ca2852ef411" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:38:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-037c21c0-c946-4908-a095-1ca2852ef411" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:38:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "cinder-quobyte-68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:38:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:38:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] Deleting offline snapshot 68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 of volume 037c21c0-c946-4908-a095-1ca2852ef411 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:38:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] snapshot_file for this snap is: volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:38:32 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9596a38-2114-44d0-971a-9de890a83a9e]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:38:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:32 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 Jul 19 17:38:32 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:32 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4" returned: 0 in 0.511s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-037c21c0-c946-4908-a095-1ca2852ef411(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:38:32 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6ba690-96c3-4c47-804a-2367aaa221c7]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:38:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:33 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 Jul 19 17:38:33 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:33 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411" returned: 0 in 0.503s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:33 devstack sudo[92017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 Jul 19 17:38:33 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:33 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-47ee7a19-5277-47c4-9a12-c7648ea4243c req-409fbb43-c986-4a25-84fc-d24928a3865d tempest-ServerActionsTestOtherA-385325392 None] Terminate volume connection completed successfully. Jul 19 17:38:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-47ee7a19-5277-47c4-9a12-c7648ea4243c req-409fbb43-c986-4a25-84fc-d24928a3865d tempest-ServerActionsTestOtherA-385325392 None] Deleting attachment 3d25ccaa-4bb8-4eba-9733-9cb6b46ee71a. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:38:34 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4" returned: 0 in 0.776s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:34 devstack sudo[92075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4 Jul 19 17:38:34 devstack sudo[92075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:34 devstack sudo[92075]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411.68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4" returned: 0 in 0.619s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:38:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:38:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:38:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:34 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:38:34 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-68cbf5e1-9e36-4de2-8e88-e0f3f5716bb4" released by "_delete_snapshot" :: held 2.617s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:38:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-037c21c0-c946-4908-a095-1ca2852ef411" released by "delete_snapshot" :: held 2.670s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:38:35 devstack cinder-volume[87676]: WARNING cinder.quota [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-199217164 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-199217164, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:38:35 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] Created reservations ['b3f015c3-08a1-4068-8b66-d94700d994dc', 'eeda1781-9f82-4bfd-9e62-d7845e1f71d5', 'e1bad097-2e04-4136-89ef-6c61379e8095', 'df0393b0-1e9d-4209-b6e9-38f277ce6aa3'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:38:35 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.500s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:38:35 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-bea9ac8f-d8b2-4f8f-ac89-1db3379f5145 tempest-GroupSnapshotsTest-1283131101 None] group_snapshot d85cf6bc-67c2-4130-b96a-d9a642aba20a: deleted successfully Jul 19 17:38:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "cinder-quobyte-037c21c0-c946-4908-a095-1ca2852ef411" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:38:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-037c21c0-c946-4908-a095-1ca2852ef411" acquired by "delete_volume" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:38:36 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa2f6ab-5b7d-41c8-a5e8-4de37ad15ac5]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:38:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:36 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 Jul 19 17:38:36 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:37 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411" returned: 0 in 0.729s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:37 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411 Jul 19 17:38:37 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:37 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-037c21c0-c946-4908-a095-1ca2852ef411" returned: 0 in 0.389s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-037c21c0-c946-4908-a095-1ca2852ef411" released by "delete_volume" :: held 1.258s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:38:38 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] Created reservations ['46b431e7-14b1-4ac3-a4bb-b8cf4fdcd2fb'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:38:38 devstack cinder-volume[87676]: WARNING cinder.db.api [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-199217164'] Jul 19 17:38:38 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] Created reservations ['d90ede6f-0a61-4670-833a-a6d5e22082ac', '04446c6a-e307-443c-a123-785b4b6d692b', 'a3c8b8b7-9d1c-450c-821a-eb0935f8dd75', 'b6333886-e3bb-48a2-82de-942cac3f8a8d'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:38:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:38:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:38:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:38 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:38:38 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:38 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.566s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:39 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:38:39 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-321e7906-a837-4798-af6f-149ee9fed139 tempest-GroupSnapshotsTest-1283131101 None] Delete group completed successfully. Jul 19 17:38:40 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-bb38758e-54b3-494d-9483-de2ec23a3612 tempest-GroupSnapshotsTest-1283131101 None] Group tempest-GroupSnapshotsTest-Group-991688910: creating Jul 19 17:38:40 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-bb38758e-54b3-494d-9483-de2ec23a3612 tempest-GroupSnapshotsTest-1283131101 None] Group tempest-GroupSnapshotsTest-Group-991688910: created successfully Jul 19 17:38:40 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-bb38758e-54b3-494d-9483-de2ec23a3612 tempest-GroupSnapshotsTest-1283131101 None] Create group completed successfully. Jul 19 17:38:41 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Flow 'volume_create_manager' (08ca8fa7-7938-4160-a2ee-49e7ecf4a017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d641ceff-b893-4c28-bea8-fe2546d7a4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d641ceff-b893-4c28-bea8-fe2546d7a4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1273131511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8646b882-f555-4bf2-b5d2-57307a67b903,host='devstack@QuobyteHD#QuobyteHD',id=63ec9e66-e2c1-41ae-b5ec-3326beb062d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d585f7dc5a479bbd9e0a2d7d07eb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:38:42Z,use_quota=True,user_id='5759b5c5926147f9b333c4c7809ec020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88cdfdd4-9c7d-4c11-a5eb-bc82ccf3cd62),volume_type_id=88cdfdd4-9c7d-4c11-a5eb-bc82ccf3cd62)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4b0ad8-d4c4-4286-90c1-2cb02356b29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4b0ad8-d4c4-4286-90c1-2cb02356b29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92698f15-9983-48fe-ae21-1f97d1183a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92698f15-9983-48fe-ae21-1f97d1183a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ec9e66-e2c1-41ae-b5ec-3326beb062d7', 'volume_name': 'volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4680df5f-ab3e-418c-a7e7-d04f75b334f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4680df5f-ab3e-418c-a7e7-d04f75b334f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4dc4a65-ded8-4918-8199-8594eb5c6d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:42 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Volume 63ec9e66-e2c1-41ae-b5ec-3326beb062d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7', 'volume_size': 1} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8646b882-f555-4bf2-b5d2-57307a67b903,created_at=2026-07-19T15:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1273131511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8646b882-f555-4bf2-b5d2-57307a67b903,host='devstack@QuobyteHD#QuobyteHD',id=63ec9e66-e2c1-41ae-b5ec-3326beb062d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d585f7dc5a479bbd9e0a2d7d07eb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:38:42Z,use_quota=True,user_id='5759b5c5926147f9b333c4c7809ec020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88cdfdd4-9c7d-4c11-a5eb-bc82ccf3cd62),volume_type_id=88cdfdd4-9c7d-4c11-a5eb-bc82ccf3cd62)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Creating volume 63ec9e66-e2c1-41ae-b5ec-3326beb062d7 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:38:42 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:42 devstack sudo[92162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 1073741824 Jul 19 17:38:42 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Acquiring lock "cinder-98436419-665f-438b-b5db-f52d14a294fd-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Lock "cinder-98436419-665f-438b-b5db-f52d14a294fd-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Acquiring lock "cinder-quobyte-98436419-665f-438b-b5db-f52d14a294fd" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Lock "cinder-quobyte-98436419-665f-438b-b5db-f52d14a294fd" acquired by "delete_volume" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9783344f-e1fa-4afd-bfb1-a966203b39e9]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-98436419-665f-438b-b5db-f52d14a294fd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:42 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 1073741824" returned: 0 in 0.765s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:43 devstack sudo[92202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-98436419-665f-438b-b5db-f52d14a294fd Jul 19 17:38:43 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:43 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 Jul 19 17:38:43 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:43 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7" returned: 0 in 0.702s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:38:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:43 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4dc4a65-ded8-4918-8199-8594eb5c6d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:43 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981ecb57-6fa9-4812-bcef-41fee22f02d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:43 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Volume volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 (63ec9e66-e2c1-41ae-b5ec-3326beb062d7): created successfully Jul 19 17:38:43 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981ecb57-6fa9-4812-bcef-41fee22f02d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:43 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:43 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Flow 'volume_create_manager' (08ca8fa7-7938-4160-a2ee-49e7ecf4a017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:38:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-98436419-665f-438b-b5db-f52d14a294fd" returned: 0 in 0.968s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-98436419-665f-438b-b5db-f52d14a294fd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:43 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-cfdeb1a3-7ff4-4b29-bd19-a4c8ac689fe8 tempest-GroupSnapshotsTest-1283131101 None] Created volume successfully. Jul 19 17:38:43 devstack sudo[92211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-98436419-665f-438b-b5db-f52d14a294fd Jul 19 17:38:43 devstack sudo[92211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-98436419-665f-438b-b5db-f52d14a294fd" returned: 0 in 0.339s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:44 devstack sudo[92211]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Lock "cinder-quobyte-98436419-665f-438b-b5db-f52d14a294fd" released by "delete_volume" :: held 1.388s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:38:44 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Created reservations ['4510b609-7742-4a6d-bf32-4b529c654e95', 'd1d65a61-5643-462d-8814-545945e96d22', '49b03994-7ab8-4825-b35e-177604155780', '412516fc-713d-4517-8afe-d13db3b37c9e'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:38:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:38:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:38:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:44 devstack sudo[92253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:38:44 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:45 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.848s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:45 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:38:45 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Deleted volume successfully. Jul 19 17:38:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d5ababb5-46d2-4fc2-b00b-e81b3fdd2ba7 tempest-ServerActionsTestOtherA-385325392 None] Lock "cinder-98436419-665f-438b-b5db-f52d14a294fd-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Flow 'volume_create_manager' (bed36d2c-eee0-4163-9ef4-b56fa04d6803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7c2ab5-39b9-4a5b-9680-df019fb3b811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7c2ab5-39b9-4a5b-9680-df019fb3b811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1279563143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8646b882-f555-4bf2-b5d2-57307a67b903,host='devstack@QuobyteHD#QuobyteHD',id=b7d4a909-4066-4ccc-b06f-5308177d6e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d585f7dc5a479bbd9e0a2d7d07eb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:38:47Z,use_quota=True,user_id='5759b5c5926147f9b333c4c7809ec020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88cdfdd4-9c7d-4c11-a5eb-bc82ccf3cd62),volume_type_id=88cdfdd4-9c7d-4c11-a5eb-bc82ccf3cd62)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8e1bc5-6838-4f78-9778-f8c88d79cf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8e1bc5-6838-4f78-9778-f8c88d79cf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7350ddc-5979-4c61-878a-dd0d732ba7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7350ddc-5979-4c61-878a-dd0d732ba7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7d4a909-4066-4ccc-b06f-5308177d6e36', 'volume_name': 'volume-b7d4a909-4066-4ccc-b06f-5308177d6e36', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcbd1a0-a29c-42ff-ad7f-a6d307a15f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcbd1a0-a29c-42ff-ad7f-a6d307a15f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab637026-f340-404a-9ded-e11fc5313b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:47 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Volume b7d4a909-4066-4ccc-b06f-5308177d6e36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7d4a909-4066-4ccc-b06f-5308177d6e36', 'volume_size': 1} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8646b882-f555-4bf2-b5d2-57307a67b903,created_at=2026-07-19T15:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1279563143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8646b882-f555-4bf2-b5d2-57307a67b903,host='devstack@QuobyteHD#QuobyteHD',id=b7d4a909-4066-4ccc-b06f-5308177d6e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d585f7dc5a479bbd9e0a2d7d07eb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:38:47Z,use_quota=True,user_id='5759b5c5926147f9b333c4c7809ec020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88cdfdd4-9c7d-4c11-a5eb-bc82ccf3cd62),volume_type_id=88cdfdd4-9c7d-4c11-a5eb-bc82ccf3cd62)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Creating volume b7d4a909-4066-4ccc-b06f-5308177d6e36 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:38:47 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:38:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:47 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 1073741824 Jul 19 17:38:47 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:48 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 1073741824" returned: 0 in 1.163s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:48 devstack sudo[92325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 Jul 19 17:38:48 devstack sudo[92325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:49 devstack sudo[92325]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36" returned: 0 in 0.484s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:38:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab637026-f340-404a-9ded-e11fc5313b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d4a909-4066-4ccc-b06f-5308177d6e36', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6958176-2e73-4d4f-bf6b-5a2d1f50ceae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:38:49 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Volume volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 (b7d4a909-4066-4ccc-b06f-5308177d6e36): created successfully Jul 19 17:38:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6958176-2e73-4d4f-bf6b-5a2d1f50ceae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:38:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Flow 'volume_create_manager' (bed36d2c-eee0-4163-9ef4-b56fa04d6803) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:38:49 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-2675ad9b-5bde-4566-8b15-6b406f36217a tempest-GroupSnapshotsTest-1283131101 None] Created volume successfully. Jul 19 17:38:49 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-3b1901d4-5efa-414e-b8dc-5e5bcb3a7d92 tempest-GroupSnapshotsTest-1283131101 None] Update group completed successfully. Jul 19 17:38:51 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-56ee2dd9-314e-44f4-a362-bf0d5ac54573 tempest-GroupSnapshotsTest-1283131101 None] Update group completed successfully. Jul 19 17:38:52 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8366403c-b3f1-416b-84f3-228e9a371833 tempest-GroupSnapshotsTest-1283131101 None] Update group completed successfully. Jul 19 17:38:53 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-53b9946b-6eb4-45a0-8206-39aac8f31b3d tempest-GroupSnapshotsTest-1283131101 None] Update group completed successfully. Jul 19 17:38:55 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] GroupSnapshot 308cffcf-85e3-43a9-9c66-6f770c4af728: creating. Jul 19 17:38:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Group snapshot 308cffcf-85e3-43a9-9c66-6f770c4af728: creating. {{(pid=87676) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 19 17:38:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Creating offline snapshot 48d2e751-5177-433f-b622-af3a64d58824 of volume 63ec9e66-e2c1-41ae-b5ec-3326beb062d7 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:38:55 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28143ec-0c6d-4880-a59a-4bac74986e2c]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:38:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:55 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 Jul 19 17:38:55 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:55 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7" returned: 0 in 0.513s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:55 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824 1G Jul 19 17:38:55 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:56 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824 1G" returned: 0 in 0.744s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:56 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824 Jul 19 17:38:56 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:57 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824" returned: 0 in 0.403s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:57 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824 is being set with open permissions: ugo+rw: NotImplementedError Jul 19 17:38:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:57 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824 Jul 19 17:38:57 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:57 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824" returned: 0 in 0.266s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:57 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.info Jul 19 17:38:57 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:57 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.info" returned: 0 in 0.397s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:57 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 19 17:38:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:57 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.info Jul 19 17:38:57 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:58 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.info" returned: 0 in 0.277s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.733s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:38:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:38:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:38:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Creating offline snapshot ffdaf536-27b9-40e4-a68e-4f19439f2225 of volume b7d4a909-4066-4ccc-b06f-5308177d6e36 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:38:58 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecadca4-2100-49e1-92de-ebb6c2bbac0c]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:38:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:58 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 Jul 19 17:38:58 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:58 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36" returned: 0 in 0.392s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:58 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225 1G Jul 19 17:38:58 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:58 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225 1G" returned: 0 in 0.406s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:58 devstack sudo[92388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225 Jul 19 17:38:58 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:59 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225" returned: 0 in 0.335s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:59 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225 is being set with open permissions: ugo+rw: NotImplementedError Jul 19 17:38:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:59 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225 Jul 19 17:38:59 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:59 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225" returned: 0 in 0.283s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:59 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.info Jul 19 17:38:59 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:38:59 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Jul 19 17:38:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.info" returned: 0 in 0.327s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:38:59 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.info is being set with open permissions: ugo+rw: NotImplementedError Jul 19 17:38:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:38:59 devstack sudo[92437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.info Jul 19 17:38:59 devstack sudo[92437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:00 devstack sudo[92437]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.info" returned: 0 in 0.290s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.135s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:00 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-849434e8-9c41-4061-8a51-c720c8b1bc0b tempest-GroupSnapshotsTest-1283131101 None] group_snapshot 308cffcf-85e3-43a9-9c66-6f770c4af728: created successfully Jul 19 17:39:00 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] group_snapshot 308cffcf-85e3-43a9-9c66-6f770c4af728: deleting Jul 19 17:39:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] group_snapshot 308cffcf-85e3-43a9-9c66-6f770c4af728: deleting {{(pid=87676) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 19 17:39:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "cinder-quobyte-63ec9e66-e2c1-41ae-b5ec-3326beb062d7" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:39:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-63ec9e66-e2c1-41ae-b5ec-3326beb062d7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:39:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "cinder-quobyte-48d2e751-5177-433f-b622-af3a64d58824" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:39:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-48d2e751-5177-433f-b622-af3a64d58824" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Deleting offline snapshot 48d2e751-5177-433f-b622-af3a64d58824 of volume 63ec9e66-e2c1-41ae-b5ec-3326beb062d7 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] snapshot_file for this snap is: volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fd9d2e-28ef-479b-9141-3fe031620587]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:01 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824 Jul 19 17:39:01 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Flow 'volume_create_manager' (5d7b9a3d-af79-4aee-aab4-7ca5c109c486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20dbdb0-34b1-4b6a-b360-d740e17720f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20dbdb0-34b1-4b6a-b360-d740e17720f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1087141604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36c9641-a01e-4e32-a01b-8fe8450e7ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28818042379c4d559eb0e471a6ceb4b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:39:01Z,use_quota=True,user_id='910c4f3f32214111b4ecf65618932db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116f7c83-103d-47a3-8bae-deaa0116cfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116f7c83-103d-47a3-8bae-deaa0116cfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9feed9f-22c1-451b-9723-31a77ed3b1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9feed9f-22c1-451b-9723-31a77ed3b1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c36c9641-a01e-4e32-a01b-8fe8450e7ca2', 'volume_name': 'volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce3cb92b-44d4-41f9-8a76-c4bdb3cf7b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce3cb92b-44d4-41f9-8a76-c4bdb3cf7b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd156bf2-e5b1-4e3c-8af5-13899c9760c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:01 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Volume c36c9641-a01e-4e32-a01b-8fe8450e7ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2', 'volume_size': 1} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1087141604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36c9641-a01e-4e32-a01b-8fe8450e7ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28818042379c4d559eb0e471a6ceb4b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:39:01Z,use_quota=True,user_id='910c4f3f32214111b4ecf65618932db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Creating volume c36c9641-a01e-4e32-a01b-8fe8450e7ca2 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:39:01 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:01 devstack sudo[92451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2 1073741824 Jul 19 17:39:01 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:01 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824" returned: 0 in 0.492s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[210ed71f-c2bc-41f4-ad53-46c466079ab2]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:01 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 Jul 19 17:39:01 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:01 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2 1073741824" returned: 0 in 0.474s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:01 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7" returned: 0 in 0.389s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:02 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824 Jul 19 17:39:02 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:02 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2 Jul 19 17:39:02 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:02 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2" returned: 0 in 0.273s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd156bf2-e5b1-4e3c-8af5-13899c9760c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e866621f-8bb7-4dd2-85ab-27266ce11925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:02 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Volume volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2 (c36c9641-a01e-4e32-a01b-8fe8450e7ca2): created successfully Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e866621f-8bb7-4dd2-85ab-27266ce11925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Flow 'volume_create_manager' (5d7b9a3d-af79-4aee-aab4-7ca5c109c486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:39:02 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f23a166b-b3d7-4407-ad82-969bd127a795 tempest-AttachVolumeTestJSON-374548148 None] Created volume successfully. Jul 19 17:39:02 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824" returned: 0 in 0.410s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:02 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824 Jul 19 17:39:02 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:02 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7.48d2e751-5177-433f-b622-af3a64d58824" returned: 0 in 0.275s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-48d2e751-5177-433f-b622-af3a64d58824" released by "_delete_snapshot" :: held 1.709s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-63ec9e66-e2c1-41ae-b5ec-3326beb062d7" released by "delete_snapshot" :: held 1.747s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "cinder-quobyte-b7d4a909-4066-4ccc-b06f-5308177d6e36" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-b7d4a909-4066-4ccc-b06f-5308177d6e36" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "cinder-quobyte-ffdaf536-27b9-40e4-a68e-4f19439f2225" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-ffdaf536-27b9-40e4-a68e-4f19439f2225" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Deleting offline snapshot ffdaf536-27b9-40e4-a68e-4f19439f2225 of volume b7d4a909-4066-4ccc-b06f-5308177d6e36 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] snapshot_file for this snap is: volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d5f589-0b77-4fa4-8f3a-dded0757ecc9]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:39:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:02 devstack sudo[92479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225 Jul 19 17:39:02 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:03 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225" returned: 0 in 0.359s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:03 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7d4a909-4066-4ccc-b06f-5308177d6e36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:39:03 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bb9dc6-a5e1-4db6-b0c3-6d690e10c26d]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:39:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:03 devstack sudo[92484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 Jul 19 17:39:03 devstack sudo[92484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:03 devstack sudo[92484]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36" returned: 0 in 0.430s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:03 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225 Jul 19 17:39:03 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:04 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225" returned: 0 in 0.644s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:04 devstack sudo[92515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225 Jul 19 17:39:04 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-f86b0cbb-d553-4a1e-a199-041935585c44 req-965de6ad-d154-4f7a-aa44-6e892bc3724e tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-f86b0cbb-d553-4a1e-a199-041935585c44 req-965de6ad-d154-4f7a-aa44-6e892bc3724e tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-f86b0cbb-d553-4a1e-a199-041935585c44 req-965de6ad-d154-4f7a-aa44-6e892bc3724e tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-f86b0cbb-d553-4a1e-a199-041935585c44 req-965de6ad-d154-4f7a-aa44-6e892bc3724e tempest-AttachVolumeTestJSON-374548148 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '316d7915-d699-4219-aa35-5f26722aa06c', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:39:04 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-f86b0cbb-d553-4a1e-a199-041935585c44 req-965de6ad-d154-4f7a-aa44-6e892bc3724e tempest-AttachVolumeTestJSON-374548148 None] attachment_update completed successfully. Jul 19 17:39:04 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36.ffdaf536-27b9-40e4-a68e-4f19439f2225" returned: 0 in 0.280s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-ffdaf536-27b9-40e4-a68e-4f19439f2225" released by "_delete_snapshot" :: held 1.821s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:39:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-b7d4a909-4066-4ccc-b06f-5308177d6e36" released by "delete_snapshot" :: held 1.845s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:39:04 devstack cinder-volume[87676]: WARNING cinder.quota [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-942279830 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-942279830, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:39:04 devstack cinder-volume[87676]: WARNING cinder.quota [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-942279830 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-942279830, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:39:04 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Created reservations ['24c14af1-3804-49bb-a098-a3d0a8605784', 'a4e9fb51-d6f1-447a-a0cf-71c5f7474824', '6ed5c6d0-3273-4ecd-9ca0-75178b4fd1d5', '4df927ce-0eb2-48d4-a0f5-a4cb0fc94a27'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:39:04 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] Created reservations ['b4b6a6ff-9cc1-4980-93bf-4bdf865b1f77', '949b7a7f-b727-4a12-8ce1-b63fb80af411', '6b756c87-6489-4dab-a6e0-3ae1507980cf', '34bbff89-4922-46bf-8394-b126fb7ac5d7'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:39:04 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-96054498-bf5f-4c32-8479-5893b8dc1a7f tempest-GroupSnapshotsTest-1283131101 None] group_snapshot 308cffcf-85e3-43a9-9c66-6f770c4af728: deleted successfully Jul 19 17:39:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "cinder-quobyte-63ec9e66-e2c1-41ae-b5ec-3326beb062d7" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:39:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-63ec9e66-e2c1-41ae-b5ec-3326beb062d7" acquired by "delete_volume" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:39:05 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbb5e56-da3c-456a-857c-ebee5aa77b0d]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:39:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:06 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 Jul 19 17:39:06 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:06 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7" returned: 0 in 0.502s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:06 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7 Jul 19 17:39:06 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:07 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-63ec9e66-e2c1-41ae-b5ec-3326beb062d7" returned: 0 in 0.580s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-63ec9e66-e2c1-41ae-b5ec-3326beb062d7" released by "delete_volume" :: held 1.197s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:39:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "cinder-quobyte-b7d4a909-4066-4ccc-b06f-5308177d6e36" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:39:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-b7d4a909-4066-4ccc-b06f-5308177d6e36" acquired by "delete_volume" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:39:07 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2734997-b4cb-4409-8a6d-05bb52c41d31]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:39:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:07 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 Jul 19 17:39:07 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:07 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36" returned: 0 in 0.543s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:07 devstack sudo[92934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36 Jul 19 17:39:07 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:08 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b7d4a909-4066-4ccc-b06f-5308177d6e36" returned: 0 in 0.325s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-b7d4a909-4066-4ccc-b06f-5308177d6e36" released by "delete_volume" :: held 0.991s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:39:08 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Created reservations ['e4020901-d2b3-4a84-8194-9c3ada4e4df4'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:39:08 devstack cinder-volume[87676]: WARNING cinder.quota [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-942279830 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-942279830, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:39:08 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Created reservations ['5613825d-8ae4-4abf-bd31-ef3d5e8bec90', 'a3fb6d6f-e086-4e5a-bb03-ebe2484cec5b', 'f7224a63-d2cc-4190-b749-f194d9706772', '80a2195a-4e02-4e79-9563-7b125d046b80'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:39:08 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Created reservations ['af03ba77-247e-4ed4-8ef5-15f4c049ab52', 'ac8727e6-d93c-4b0d-9729-6a24f19073ad', '65d2a6b3-4b3c-4394-97a1-89e3df946b7a', '564d2789-e88c-44eb-a5f3-02662823045f'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:39:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:39:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:39:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:08 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:39:08 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:09 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.367s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:09 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:39:09 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-df2b8675-290c-406e-9c10-4b88463abbc8 tempest-GroupSnapshotsTest-1283131101 None] Delete group completed successfully. Jul 19 17:39:10 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-1d309a9e-666e-4790-bbae-43bd64c4b49a tempest-GroupSnapshotsTest-1283131101 None] Group tempest-GroupSnapshotsTest-Group-755837001: creating Jul 19 17:39:10 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-1d309a9e-666e-4790-bbae-43bd64c4b49a tempest-GroupSnapshotsTest-1283131101 None] Group tempest-GroupSnapshotsTest-Group-755837001: created successfully Jul 19 17:39:10 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-1d309a9e-666e-4790-bbae-43bd64c4b49a tempest-GroupSnapshotsTest-1283131101 None] Create group completed successfully. Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Flow 'volume_create_manager' (75a4b4a2-679a-45f0-9612-3ab8d1856876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d844a15-5b68-4599-8f74-c06db6cfb16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d844a15-5b68-4599-8f74-c06db6cfb16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-416811030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e6d53c-dc91-4053-8861-c4ce92ccee1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a870cb79ff347d09eba7e9c73bf9873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:39:11Z,use_quota=True,user_id='10ed18fa19fd44bc9a8b313e97f08343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd52b72-cd11-4ced-9af2-72dcbd9bfe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd52b72-cd11-4ced-9af2-72dcbd9bfe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a07551e-f9d4-4077-b014-f27c0238dbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a07551e-f9d4-4077-b014-f27c0238dbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64e6d53c-dc91-4053-8861-c4ce92ccee1b', 'volume_name': 'volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc6700a-3965-4e53-b43b-e96f2fdc2b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc6700a-3965-4e53-b43b-e96f2fdc2b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9380b87a-50ed-4fa8-a199-bb302a17820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:11 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Volume 64e6d53c-dc91-4053-8861-c4ce92ccee1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b', 'volume_size': 1} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-416811030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e6d53c-dc91-4053-8861-c4ce92ccee1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a870cb79ff347d09eba7e9c73bf9873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:39:11Z,use_quota=True,user_id='10ed18fa19fd44bc9a8b313e97f08343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Creating volume 64e6d53c-dc91-4053-8861-c4ce92ccee1b {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:39:11 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:39:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:11 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b 1073741824 Jul 19 17:39:11 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:12 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b 1073741824" returned: 0 in 0.724s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:12 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b Jul 19 17:39:12 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:39:12 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Flow 'volume_create_manager' (a3793703-06c8-4b0e-9e8c-5596cccddd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e261c318-d7e2-45e3-b1e9-5dbf4eb0b063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b" returned: 0 in 0.502s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e261c318-d7e2-45e3-b1e9-5dbf4eb0b063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1613044455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cc779ff3-61dd-42c9-b03c-4848a7233584,host='devstack@QuobyteHD#QuobyteHD',id=6216059b-7ed4-4c3a-be2b-c53cfea6c244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d585f7dc5a479bbd9e0a2d7d07eb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:39:13Z,use_quota=True,user_id='5759b5c5926147f9b333c4c7809ec020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31357adc-0304-4a2d-aeeb-8725a00968ee),volume_type_id=31357adc-0304-4a2d-aeeb-8725a00968ee)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8927e98-1035-49e7-8e9a-5acf1b5303ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8927e98-1035-49e7-8e9a-5acf1b5303ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238d2177-b1c4-4f56-9020-02d3100faa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238d2177-b1c4-4f56-9020-02d3100faa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6216059b-7ed4-4c3a-be2b-c53cfea6c244', 'volume_name': 'volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9503fc3-8f22-4e4e-ad6d-cadf322bdf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9503fc3-8f22-4e4e-ad6d-cadf322bdf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c51d5f2-1c95-4c8b-bbf1-3978980b1f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:12 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Volume 6216059b-7ed4-4c3a-be2b-c53cfea6c244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244', 'volume_size': 1} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cc779ff3-61dd-42c9-b03c-4848a7233584,created_at=2026-07-19T15:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1613044455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cc779ff3-61dd-42c9-b03c-4848a7233584,host='devstack@QuobyteHD#QuobyteHD',id=6216059b-7ed4-4c3a-be2b-c53cfea6c244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d585f7dc5a479bbd9e0a2d7d07eb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:39:13Z,use_quota=True,user_id='5759b5c5926147f9b333c4c7809ec020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31357adc-0304-4a2d-aeeb-8725a00968ee),volume_type_id=31357adc-0304-4a2d-aeeb-8725a00968ee)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Creating volume 6216059b-7ed4-4c3a-be2b-c53cfea6c244 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:39:12 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9380b87a-50ed-4fa8-a199-bb302a17820f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed536e65-d3db-4bd3-828e-f2cb1f39e6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:12 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 1073741824 Jul 19 17:39:12 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:12 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Volume volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b (64e6d53c-dc91-4053-8861-c4ce92ccee1b): created successfully Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed536e65-d3db-4bd3-828e-f2cb1f39e6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Flow 'volume_create_manager' (75a4b4a2-679a-45f0-9612-3ab8d1856876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:39:12 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-4716f7e9-dc6f-4049-bebe-c932fb908bee tempest-AttachVolumeNegativeTest-224058568 None] Created volume successfully. Jul 19 17:39:13 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 1073741824" returned: 0 in 0.697s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:13 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 Jul 19 17:39:13 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:14 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244" returned: 0 in 0.469s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:39:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c51d5f2-1c95-4c8b-bbf1-3978980b1f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0df892-019b-4b67-b965-13ca37c5f8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:14 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Volume volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 (6216059b-7ed4-4c3a-be2b-c53cfea6c244): created successfully Jul 19 17:39:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0df892-019b-4b67-b965-13ca37c5f8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Flow 'volume_create_manager' (a3793703-06c8-4b0e-9e8c-5596cccddd85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:39:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-7225c132-cf0d-43ff-9331-53c939ebb247 tempest-GroupSnapshotsTest-1283131101 None] Created volume successfully. Jul 19 17:39:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-c9666f6e-1f34-4a41-be79-df1017632817 req-25803501-e91e-490b-935f-f5a73cd97366 tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-c9666f6e-1f34-4a41-be79-df1017632817 req-25803501-e91e-490b-935f-f5a73cd97366 tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-c9666f6e-1f34-4a41-be79-df1017632817 req-25803501-e91e-490b-935f-f5a73cd97366 tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-c9666f6e-1f34-4a41-be79-df1017632817 req-25803501-e91e-490b-935f-f5a73cd97366 tempest-AttachVolumeNegativeTest-224058568 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '182a7089-9fbb-4ca6-9f94-186e970a7a5c', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:39:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-c9666f6e-1f34-4a41-be79-df1017632817 req-25803501-e91e-490b-935f-f5a73cd97366 tempest-AttachVolumeNegativeTest-224058568 None] attachment_update completed successfully. Jul 19 17:39:15 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] GroupSnapshot 2efd6ccf-68c2-44e3-bb5c-20832828b223: creating. Jul 19 17:39:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] Group snapshot 2efd6ccf-68c2-44e3-bb5c-20832828b223: creating. {{(pid=87676) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 19 17:39:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] Creating offline snapshot 11669d1a-3293-4a1c-a9dd-d77f6ec30893 of volume 6216059b-7ed4-4c3a-be2b-c53cfea6c244 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:39:15 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4f8c20-8a07-493f-87ff-6b02fbaf5dfd]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:39:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:16 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 Jul 19 17:39:16 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:16 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244" returned: 0 in 0.668s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:16 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893 1G Jul 19 17:39:16 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:17 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893 1G" returned: 0 in 0.825s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:17 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893 Jul 19 17:39:17 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:18 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893" returned: 0 in 0.791s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:18 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893 is being set with open permissions: ugo+rw: NotImplementedError Jul 19 17:39:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:18 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893 Jul 19 17:39:18 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:18 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-6ad20b28-2e4b-4136-95a9-14cf544d0a2d req-b5aadf95-4a8c-4094-96f6-91ff48a8ab5d tempest-AttachVolumeNegativeTest-224058568 None] Terminate volume connection completed successfully. Jul 19 17:39:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-6ad20b28-2e4b-4136-95a9-14cf544d0a2d req-b5aadf95-4a8c-4094-96f6-91ff48a8ab5d tempest-AttachVolumeNegativeTest-224058568 None] Deleting attachment 182a7089-9fbb-4ca6-9f94-186e970a7a5c. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:39:18 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893" returned: 0 in 0.700s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:19 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.info Jul 19 17:39:19 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:19 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.info" returned: 0 in 0.417s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:19 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.info is being set with open permissions: ugo+rw: NotImplementedError Jul 19 17:39:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:19 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.info Jul 19 17:39:19 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:20 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.info" returned: 0 in 0.529s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.127s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:20 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-64de9d44-1878-4708-adbe-86f1b8ff9ed0 tempest-GroupSnapshotsTest-1283131101 None] group_snapshot 2efd6ccf-68c2-44e3-bb5c-20832828b223: created successfully Jul 19 17:39:20 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] group_snapshot 2efd6ccf-68c2-44e3-bb5c-20832828b223: deleting Jul 19 17:39:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] group_snapshot 2efd6ccf-68c2-44e3-bb5c-20832828b223: deleting {{(pid=87676) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 19 17:39:20 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "cinder-quobyte-6216059b-7ed4-4c3a-be2b-c53cfea6c244" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:39:20 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-6216059b-7ed4-4c3a-be2b-c53cfea6c244" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:39:20 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "cinder-quobyte-11669d1a-3293-4a1c-a9dd-d77f6ec30893" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:39:20 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-11669d1a-3293-4a1c-a9dd-d77f6ec30893" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:39:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] Deleting offline snapshot 11669d1a-3293-4a1c-a9dd-d77f6ec30893 of volume 6216059b-7ed4-4c3a-be2b-c53cfea6c244 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:39:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] snapshot_file for this snap is: volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:39:20 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[223885e3-45b9-448a-b27c-484cd7f2640c]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:39:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:21 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893 Jul 19 17:39:21 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:21 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893" returned: 0 in 1.084s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:21 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:39:21 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e20d41-8eaf-4d35-8034-5cfcdd12d5be]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:39:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:22 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 Jul 19 17:39:22 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:22 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244" returned: 0 in 0.765s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:22 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893 Jul 19 17:39:22 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:23 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893" returned: 0 in 0.920s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:23 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893 Jul 19 17:39:23 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:24 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244.11669d1a-3293-4a1c-a9dd-d77f6ec30893" returned: 0 in 0.527s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-11669d1a-3293-4a1c-a9dd-d77f6ec30893" released by "_delete_snapshot" :: held 3.584s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:39:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-6216059b-7ed4-4c3a-be2b-c53cfea6c244" released by "delete_snapshot" :: held 3.638s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:39:24 devstack cinder-volume[87676]: WARNING cinder.quota [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-113972695 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-113972695, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:39:24 devstack cinder-volume[87676]: WARNING cinder.quota [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-113972695 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-113972695, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:39:24 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] Created reservations ['652576ce-4d29-45d9-9b65-4ef000eabc4e', 'b65f3cc8-394c-41df-b9dc-44e8ad6a0170', '8467a821-2586-4a9d-bc9c-a82c2b5b32f7', 'f66df5ef-2119-48b6-b4ed-c1ca2cec5e17'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:39:24 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-d1b8bb4a-baad-433d-9411-34e8edd98165 tempest-GroupSnapshotsTest-1283131101 None] group_snapshot 2efd6ccf-68c2-44e3-bb5c-20832828b223: deleted successfully Jul 19 17:39:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "cinder-quobyte-6216059b-7ed4-4c3a-be2b-c53cfea6c244" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:39:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-6216059b-7ed4-4c3a-be2b-c53cfea6c244" acquired by "delete_volume" :: waited 0.040s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:39:26 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[235dc77d-ef22-4d6e-a23c-7ec1bc5d76e1]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:39:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:26 devstack sudo[93708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 Jul 19 17:39:26 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:26 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244" returned: 0 in 0.812s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:26 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244 Jul 19 17:39:26 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:27 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6216059b-7ed4-4c3a-be2b-c53cfea6c244" returned: 0 in 0.454s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] Lock "cinder-quobyte-6216059b-7ed4-4c3a-be2b-c53cfea6c244" released by "delete_volume" :: held 1.401s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:39:27 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] Created reservations ['2d390042-a68f-469e-90fd-ba63f3e7e7b7'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:39:27 devstack cinder-volume[87676]: WARNING cinder.quota [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-113972695 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-113972695, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:39:27 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] Created reservations ['82abe3bc-3f86-4ed2-8d77-231e0e83c712', 'a0dcea45-5096-41c2-944e-f07e20e0de75', 'bbc344db-ab49-48f8-89df-04a48380de8d', '8844160e-2caa-419b-9908-a545733bf2b4'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:39:27 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=120,cinder:UPDATE=122,cinder:INSERT=30,cinder:DELETE=2 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:39:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:27 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:39:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:39:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:28 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:39:28 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:28 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.385s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:28 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:39:28 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-febf3219-74da-43a3-8c1c-9233c386b39b tempest-GroupSnapshotsTest-1283131101 None] Delete group completed successfully. Jul 19 17:39:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:39:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:39:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:39:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:34 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:39:34 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:35 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.671s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:39:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:39:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 8 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:39:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:39:37 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-a89bfa49-b438-4a34-9687-6749488b6223 req-ff7dc91b-3f3b-4f2a-a961-63d5891a3146 tempest-AttachVolumeTestJSON-374548148 None] Terminate volume connection completed successfully. Jul 19 17:39:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-a89bfa49-b438-4a34-9687-6749488b6223 req-ff7dc91b-3f3b-4f2a-a961-63d5891a3146 tempest-AttachVolumeTestJSON-374548148 None] Deleting attachment 316d7915-d699-4219-aa35-5f26722aa06c. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:39:37 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=121,cinder:UPDATE=104,cinder:INSERT=22,cinder:DELETE=4 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Flow 'volume_create_manager' (f6aecc53-b881-4b8a-9451-42d6fa64ce76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85f731f-ae72-4344-9b64-68732ff7f5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85f731f-ae72-4344-9b64-68732ff7f5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-95795041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d41698-6edd-46de-8932-564707d95aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c97248db834f57b1b5358eb25a82fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:39:38Z,use_quota=True,user_id='c9e9f85484794ba082f9c5db11ca5440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e92dbe-70e0-4131-b1c7-8b582c0bd1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e92dbe-70e0-4131-b1c7-8b582c0bd1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8d7b9d-5894-4cd8-a491-385ab6a4ff4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8d7b9d-5894-4cd8-a491-385ab6a4ff4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6d41698-6edd-46de-8932-564707d95aaf', 'volume_name': 'volume-f6d41698-6edd-46de-8932-564707d95aaf', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b60e62-1beb-4d8f-a5f7-df8864e821d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b60e62-1beb-4d8f-a5f7-df8864e821d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf44bf4b-61c3-462c-b958-269317d73efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:38 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Volume f6d41698-6edd-46de-8932-564707d95aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6d41698-6edd-46de-8932-564707d95aaf', 'volume_size': 1} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-95795041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d41698-6edd-46de-8932-564707d95aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c97248db834f57b1b5358eb25a82fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:39:38Z,use_quota=True,user_id='c9e9f85484794ba082f9c5db11ca5440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Creating volume f6d41698-6edd-46de-8932-564707d95aaf {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:39:38 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:39:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f6d41698-6edd-46de-8932-564707d95aaf 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:38 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f6d41698-6edd-46de-8932-564707d95aaf 1073741824 Jul 19 17:39:38 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:39 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f6d41698-6edd-46de-8932-564707d95aaf 1073741824" returned: 0 in 1.499s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f6d41698-6edd-46de-8932-564707d95aaf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:40 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f6d41698-6edd-46de-8932-564707d95aaf Jul 19 17:39:40 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:40 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f6d41698-6edd-46de-8932-564707d95aaf" returned: 0 in 0.829s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:40 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] <== create_volume: return (2452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:39:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.459s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf44bf4b-61c3-462c-b958-269317d73efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6d41698-6edd-46de-8932-564707d95aaf', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6d0400-75a7-46c3-b4cd-ddd4fc674952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:40 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Volume volume-f6d41698-6edd-46de-8932-564707d95aaf (f6d41698-6edd-46de-8932-564707d95aaf): created successfully Jul 19 17:39:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6d0400-75a7-46c3-b4cd-ddd4fc674952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Flow 'volume_create_manager' (f6aecc53-b881-4b8a-9451-42d6fa64ce76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:39:40 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-894bee33-f061-4dda-9e1d-784159fe43fb tempest-ServerRescueNegativeTestJSON-543534110 None] Created volume successfully. Jul 19 17:39:50 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:39:50 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:39:53 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8242c5c1-2a66-4b09-9661-7b4f66efb9e7 tempest-GroupsV314Test-1407420758 None] Group tempest-GroupsV314Test-Group-1825118723: creating Jul 19 17:39:53 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8242c5c1-2a66-4b09-9661-7b4f66efb9e7 tempest-GroupsV314Test-1407420758 None] Group tempest-GroupsV314Test-Group-1825118723: created successfully Jul 19 17:39:53 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8242c5c1-2a66-4b09-9661-7b4f66efb9e7 tempest-GroupsV314Test-1407420758 None] Create group completed successfully. Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Flow 'volume_create_manager' (015ea5f1-78d5-4644-81bb-5567b2e94e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9040d7-2248-4010-be77-94ff50fdf69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9040d7-2248-4010-be77-94ff50fdf69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-30365091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=163e4887-322f-461f-83b9-16186fbb762b,host='devstack@QuobyteHD#QuobyteHD',id=be567499-b421-4e98-9f84-ed1658fca712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a96e0eaf3a4a8db286b20cc3e0ddc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:39:55Z,use_quota=True,user_id='4b451bd02f8f4fd8a49cb4929c1e5a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90bf3e91-ada1-4253-a843-f35f9eb3e850),volume_type_id=90bf3e91-ada1-4253-a843-f35f9eb3e850)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b3ee78-54bc-448b-9e57-16b362e3e285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b3ee78-54bc-448b-9e57-16b362e3e285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75566498-86b9-4ac8-bfea-6016605f06a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75566498-86b9-4ac8-bfea-6016605f06a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be567499-b421-4e98-9f84-ed1658fca712', 'volume_name': 'volume-be567499-b421-4e98-9f84-ed1658fca712', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8cd34ab-668d-4b80-92d5-9abedccf37f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8cd34ab-668d-4b80-92d5-9abedccf37f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62e8f5b-3a8c-484b-ba34-7ac80abe0f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:55 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Volume be567499-b421-4e98-9f84-ed1658fca712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be567499-b421-4e98-9f84-ed1658fca712', 'volume_size': 1} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=163e4887-322f-461f-83b9-16186fbb762b,created_at=2026-07-19T15:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-30365091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=163e4887-322f-461f-83b9-16186fbb762b,host='devstack@QuobyteHD#QuobyteHD',id=be567499-b421-4e98-9f84-ed1658fca712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a96e0eaf3a4a8db286b20cc3e0ddc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:39:55Z,use_quota=True,user_id='4b451bd02f8f4fd8a49cb4929c1e5a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90bf3e91-ada1-4253-a843-f35f9eb3e850),volume_type_id=90bf3e91-ada1-4253-a843-f35f9eb3e850)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Creating volume be567499-b421-4e98-9f84-ed1658fca712 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:39:55 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:39:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:55 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 1073741824 Jul 19 17:39:55 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:56 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 1073741824" returned: 0 in 0.907s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:56 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 Jul 19 17:39:56 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:56 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712" returned: 0 in 0.276s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:39:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62e8f5b-3a8c-484b-ba34-7ac80abe0f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be567499-b421-4e98-9f84-ed1658fca712', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c608b2-ccf4-4b82-979f-cd5f621bcf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:39:56 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Volume volume-be567499-b421-4e98-9f84-ed1658fca712 (be567499-b421-4e98-9f84-ed1658fca712): created successfully Jul 19 17:39:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c608b2-ccf4-4b82-979f-cd5f621bcf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:39:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Flow 'volume_create_manager' (015ea5f1-78d5-4644-81bb-5567b2e94e9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:39:56 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b3a5febf-25d1-4522-bd87-c5b78bfecbe5 tempest-GroupsV314Test-1407420758 None] Created volume successfully. Jul 19 17:39:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Acquiring lock "cinder-f6d41698-6edd-46de-8932-564707d95aaf-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:39:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Lock "cinder-f6d41698-6edd-46de-8932-564707d95aaf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:39:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Acquiring lock "cinder-quobyte-f6d41698-6edd-46de-8932-564707d95aaf" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:39:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Lock "cinder-quobyte-f6d41698-6edd-46de-8932-564707d95aaf" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:39:57 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[241f8683-3f69-4dae-87d9-a5aa7e25a946]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:39:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f6d41698-6edd-46de-8932-564707d95aaf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:57 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f6d41698-6edd-46de-8932-564707d95aaf Jul 19 17:39:57 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:58 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f6d41698-6edd-46de-8932-564707d95aaf" returned: 0 in 0.470s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f6d41698-6edd-46de-8932-564707d95aaf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:58 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f6d41698-6edd-46de-8932-564707d95aaf Jul 19 17:39:58 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:58 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f6d41698-6edd-46de-8932-564707d95aaf" returned: 0 in 0.563s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:58 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Lock "cinder-quobyte-f6d41698-6edd-46de-8932-564707d95aaf" released by "delete_volume" :: held 1.115s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:39:58 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Created reservations ['362526a1-f895-4039-ade0-df60474e997b', 'a823a10b-7193-489f-8c03-32f5ebeae1e9', 'e1d25004-3f1d-4cec-bed1-c717dd62004c', '4531fe15-e066-4e09-976d-acd9979c3afa'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:39:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:39:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:39:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:39:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:59 devstack sudo[94203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:39:59 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:39:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:39:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:39:59 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Cloning volume be567499-b421-4e98-9f84-ed1658fca712 to volume 662c013c-9886-4464-adf2-73b69051fd34 Jul 19 17:39:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Creating offline snapshot 71973192-7b82-47da-bf55-fe66ec954605 of volume be567499-b421-4e98-9f84-ed1658fca712 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:39:59 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93dc1ce-1744-4b50-9082-263a964eb97e]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:39:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:39:59 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root Jul 19 17:39:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.591s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:39:59 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:39:59 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Deleted volume successfully. Jul 19 17:39:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d76acbe7-6b78-43ce-b6c0-69f1b68a1314 tempest-ServerRescueNegativeTestJSON-543534110 None] Lock "cinder-f6d41698-6edd-46de-8932-564707d95aaf-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:39:59 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 Jul 19 17:39:59 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:00 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712" returned: 0 in 0.646s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:00 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 1G Jul 19 17:40:00 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:01 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 1G" returned: 0 in 0.984s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be567499-b421-4e98-9f84-ed1658fca712 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:01 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be567499-b421-4e98-9f84-ed1658fca712 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 Jul 19 17:40:01 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:01 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be567499-b421-4e98-9f84-ed1658fca712 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605" returned: 0 in 0.803s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:01 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 is being set with open permissions: ugo+rw: NotImplementedError Jul 19 17:40:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:01 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 Jul 19 17:40:01 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:02 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605" returned: 0 in 0.760s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:02 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.info Jul 19 17:40:02 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:03 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.info" returned: 0 in 0.403s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:03 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.info is being set with open permissions: ugo+rw: NotImplementedError Jul 19 17:40:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:03 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.info Jul 19 17:40:03 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:03 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.info" returned: 0 in 0.403s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Acquiring lock "cinder-quobyte-662c013c-9886-4464-adf2-73b69051fd34" by "_copy_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Lock "cinder-quobyte-662c013c-9886-4464-adf2-73b69051fd34" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:03 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] snapshot: 71973192-7b82-47da-bf55-fe66ec954605, volume: 662c013c-9886-4464-adf2-73b69051fd34, {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 17:40:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:03 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:03 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:03 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da90d12-8071-4974-9fce-9c13337de981]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:03 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 Jul 19 17:40:03 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:04 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605" returned: 0 in 0.723s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be567499-b421-4e98-9f84-ed1658fca712(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:40:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] will copy from snapshot at /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 17:40:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Creating direct copy from snapshot {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 17:40:04 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af49153-fed7-41c0-a235-bb7a57b506c6]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:04 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 Jul 19 17:40:04 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:05 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712" returned: 0 in 0.547s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:05 devstack cinder-volume[87676]: DEBUG cinder.utils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Path /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-662c013c-9886-4464-adf2-73b69051fd34 not found in is_blk_device check {{(pid=87676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 17:40:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-662c013c-9886-4464-adf2-73b69051fd34 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:05 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-662c013c-9886-4464-adf2-73b69051fd34 Jul 19 17:40:05 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:12 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-662c013c-9886-4464-adf2-73b69051fd34" returned: 0 in 7.067s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:12 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fa1063-e6cf-4e68-8af1-3752c6c05325]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:12 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 Jul 19 17:40:12 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:12 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712" returned: 0 in 0.544s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:12 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Image conversion details: src /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712, size 1024.00 MB, duration 7.07 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-662c013c-9886-4464-adf2-73b69051fd34 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:40:12 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Converted 1024.00 MB image at 144.82 MB/s Jul 19 17:40:12 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-662c013c-9886-4464-adf2-73b69051fd34 is being set with open permissions: ugo+rw: NotImplementedError Jul 19 17:40:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-662c013c-9886-4464-adf2-73b69051fd34 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:12 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-662c013c-9886-4464-adf2-73b69051fd34 Jul 19 17:40:12 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:12 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-662c013c-9886-4464-adf2-73b69051fd34" returned: 0 in 0.256s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Lock "cinder-quobyte-662c013c-9886-4464-adf2-73b69051fd34" released by "_copy_volume_from_snapshot" :: held 9.319s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Acquiring lock "cinder-quobyte-71973192-7b82-47da-bf55-fe66ec954605" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Lock "cinder-quobyte-71973192-7b82-47da-bf55-fe66ec954605" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Deleting offline snapshot 71973192-7b82-47da-bf55-fe66ec954605 of volume be567499-b421-4e98-9f84-ed1658fca712 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:40:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] snapshot_file for this snap is: volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:40:12 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e316209-eb30-43a0-8a39-8becdce73dca]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:13 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 Jul 19 17:40:13 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:13 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605" returned: 0 in 0.365s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be567499-b421-4e98-9f84-ed1658fca712(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:40:13 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3799b80-d386-4be3-916d-353c3028056c]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:13 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 Jul 19 17:40:13 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:13 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712" returned: 0 in 0.367s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:13 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 Jul 19 17:40:13 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:14 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605" returned: 0 in 0.368s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:14 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605 Jul 19 17:40:14 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:14 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712.71973192-7b82-47da-bf55-fe66ec954605" returned: 0 in 0.306s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Lock "cinder-quobyte-71973192-7b82-47da-bf55-fe66ec954605" released by "_delete_snapshot" :: held 1.510s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.230s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-d767bb5d-d896-4864-bfd5-ae527afff181 tempest-GroupsV314Test-1407420758 None] Create group from source-group-163e4887-322f-461f-83b9-16186fbb762b completed successfully. Jul 19 17:40:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Acquiring lock "cinder-quobyte-662c013c-9886-4464-adf2-73b69051fd34" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Lock "cinder-quobyte-662c013c-9886-4464-adf2-73b69051fd34" acquired by "delete_volume" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:15 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e842d2de-780e-423a-8fb5-2a410c771c07]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-662c013c-9886-4464-adf2-73b69051fd34 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:15 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-662c013c-9886-4464-adf2-73b69051fd34 Jul 19 17:40:15 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:16 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-662c013c-9886-4464-adf2-73b69051fd34" returned: 0 in 0.461s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-662c013c-9886-4464-adf2-73b69051fd34 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:16 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-662c013c-9886-4464-adf2-73b69051fd34 Jul 19 17:40:16 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:16 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-662c013c-9886-4464-adf2-73b69051fd34" returned: 0 in 0.368s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:16 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Lock "cinder-quobyte-662c013c-9886-4464-adf2-73b69051fd34" released by "delete_volume" :: held 0.887s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:16 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Created reservations ['12366104-a88a-4eed-af13-738980fd479a'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:40:16 devstack cinder-volume[87676]: WARNING cinder.quota [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-379757867 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-379757867, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:40:16 devstack cinder-volume[87676]: WARNING cinder.quota [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-379757867 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-379757867, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:40:16 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Created reservations ['d369e9b4-c5ec-46fe-a378-7ad25a6ca0d0', 'de298c6a-3fcb-42bb-8277-3be02585299c', '61fd0bd9-5d1e-4f91-b910-1d12446c042c', '76a25c6d-67ea-42cd-97ee-c463739d040b'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:40:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:16 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:40:16 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:17 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.294s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:17 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:40:17 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-0b44469a-6a5e-4e23-967a-5631f07e3d58 tempest-GroupsV314Test-1407420758 None] Delete group completed successfully. Jul 19 17:40:17 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] Acquiring lock "cinder-quobyte-be567499-b421-4e98-9f84-ed1658fca712" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:17 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] Lock "cinder-quobyte-be567499-b421-4e98-9f84-ed1658fca712" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:17 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1071e04b-07c1-41da-a540-1fa34431cd8b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:17 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 Jul 19 17:40:17 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:17 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712" returned: 0 in 0.409s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:17 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712 Jul 19 17:40:17 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:17 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be567499-b421-4e98-9f84-ed1658fca712" returned: 0 in 0.261s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:17 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] Lock "cinder-quobyte-be567499-b421-4e98-9f84-ed1658fca712" released by "delete_volume" :: held 0.750s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:17 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] Created reservations ['2535e73b-89a8-45c8-9fb6-be5ec43fbf05'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:40:18 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] Created reservations ['d64bb1f3-0666-4251-bb50-a546695ab5d4', 'ef59b119-6f00-4ba2-9b9a-fe73f0e7eb66', '0540a116-4949-4bec-ab02-e97bd97b0596', '7dcd6f66-0121-422b-aa5c-6ee2fdc5a9b9'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:40:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:18 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:40:18 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:18 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.300s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:18 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:40:18 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-61fc32ea-00cc-499a-858d-8df70c6f1d0e tempest-GroupsV314Test-1407420758 None] Delete group completed successfully. Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Flow 'volume_create_manager' (58d41346-9d0b-4aa2-ad91-df77ed2b2a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceeca862-91f0-4d97-b218-7c1b74183377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceeca862-91f0-4d97-b218-7c1b74183377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-660140280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ff38e3-5c20-4d64-81f2-d896816bfdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313c3d32a6634f55ba7551fcbff4e653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:40:19Z,use_quota=True,user_id='3364b5fae4c1418499139e8e00f5a87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c047938a-24bb-4fce-8688-7532e5d88f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c047938a-24bb-4fce-8688-7532e5d88f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fc54e0-712e-4da2-a198-36347e0782cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fc54e0-712e-4da2-a198-36347e0782cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86ff38e3-5c20-4d64-81f2-d896816bfdb0', 'volume_name': 'volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4dbe0a-d02b-4d07-bc6a-f34b28cde179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4dbe0a-d02b-4d07-bc6a-f34b28cde179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c4956a-d8c0-494e-afa5-454edf03ea16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:19 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Volume 86ff38e3-5c20-4d64-81f2-d896816bfdb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0', 'volume_size': 1} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-660140280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ff38e3-5c20-4d64-81f2-d896816bfdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313c3d32a6634f55ba7551fcbff4e653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:40:19Z,use_quota=True,user_id='3364b5fae4c1418499139e8e00f5a87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Creating volume 86ff38e3-5c20-4d64-81f2-d896816bfdb0 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:40:19 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:19 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 1073741824 Jul 19 17:40:19 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:19 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 1073741824" returned: 0 in 0.453s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:19 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 Jul 19 17:40:19 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:19 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0" returned: 0 in 0.246s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c4956a-d8c0-494e-afa5-454edf03ea16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7a6b7a-0c3d-47fc-ad50-dfd7f467efd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:19 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Volume volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 (86ff38e3-5c20-4d64-81f2-d896816bfdb0): created successfully Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7a6b7a-0c3d-47fc-ad50-dfd7f467efd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Flow 'volume_create_manager' (58d41346-9d0b-4aa2-ad91-df77ed2b2a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:40:19 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-24ee5e03-b4c6-462d-919c-5915bfc79119 req-509ae298-c2bd-4967-a39b-48bfdde39ab9 tempest-VolumesSnapshotsTestJSON-132430927 None] Created volume successfully. Jul 19 17:40:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] Creating offline snapshot 19fda458-774d-4219-936b-b8b93651357a of volume 86ff38e3-5c20-4d64-81f2-d896816bfdb0 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:40:20 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6353bc04-5115-4763-a7d7-60dc8459a0da]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:20 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 Jul 19 17:40:20 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:20 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0" returned: 0 in 0.477s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:20 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a 1G Jul 19 17:40:20 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:21 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a 1G" returned: 0 in 0.438s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:21 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a Jul 19 17:40:21 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:21 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a" returned: 0 in 0.291s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:21 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a is being set with open permissions: ugo+rw Jul 19 17:40:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:21 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a Jul 19 17:40:21 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:21 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a" returned: 0 in 0.258s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:21 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.info Jul 19 17:40:21 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:22 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.info" returned: 0 in 0.264s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:22 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.info is being set with open permissions: ugo+rw Jul 19 17:40:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:22 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.info Jul 19 17:40:22 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:22 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.info" returned: 0 in 0.250s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.076s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:22 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-4baf7533-6bc2-43e9-98f4-ba1681569b4b req-19cfd4ff-1730-45f8-9223-3805eee16a69 tempest-VolumesSnapshotsTestJSON-132430927 None] Create snapshot completed successfully Jul 19 17:40:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Acquiring lock "cinder-19fda458-774d-4219-936b-b8b93651357a-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "cinder-19fda458-774d-4219-936b-b8b93651357a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Acquiring lock "cinder-quobyte-86ff38e3-5c20-4d64-81f2-d896816bfdb0" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "cinder-quobyte-86ff38e3-5c20-4d64-81f2-d896816bfdb0" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Acquiring lock "cinder-quobyte-19fda458-774d-4219-936b-b8b93651357a" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "cinder-quobyte-19fda458-774d-4219-936b-b8b93651357a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Deleting offline snapshot 19fda458-774d-4219-936b-b8b93651357a of volume 86ff38e3-5c20-4d64-81f2-d896816bfdb0 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:40:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] snapshot_file for this snap is: volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:40:23 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c012f3d7-f30f-4838-a3e8-4512e9c2897b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:23 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a Jul 19 17:40:23 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-fca6055b-448d-4831-bcf0-0309854446de tempest-GroupsV320Test-710388887 None] Group tempest-GroupsV320Test-Group-1617587571: creating Jul 19 17:40:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-fca6055b-448d-4831-bcf0-0309854446de tempest-GroupsV320Test-710388887 None] Group tempest-GroupsV320Test-Group-1617587571: created successfully Jul 19 17:40:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-fca6055b-448d-4831-bcf0-0309854446de tempest-GroupsV320Test-710388887 None] Create group completed successfully. Jul 19 17:40:23 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a" returned: 0 in 0.372s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:40:23 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bae35f5-1720-4364-be4a-560373510612]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:23 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 Jul 19 17:40:23 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:23 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0" returned: 0 in 0.332s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:23 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a Jul 19 17:40:23 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:24 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a" returned: 0 in 0.354s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:24 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a Jul 19 17:40:24 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:24 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0.19fda458-774d-4219-936b-b8b93651357a" returned: 0 in 0.253s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "cinder-quobyte-19fda458-774d-4219-936b-b8b93651357a" released by "_delete_snapshot" :: held 1.415s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "cinder-quobyte-86ff38e3-5c20-4d64-81f2-d896816bfdb0" released by "delete_snapshot" :: held 1.444s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:24 devstack cinder-volume[87676]: WARNING cinder.quota [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:40:24 devstack cinder-volume[87676]: DEBUG cinder.quota [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Created reservations ['00d5fa09-014b-4c5d-9303-df41d0a7560c', '1f6bd021-fa02-40b5-894c-22725bdc7307', '7ca154c8-ee45-4f05-bacc-1cb912931e88', '814eea0f-24ba-4f4e-8237-4333706e4590'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:40:24 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Delete snapshot completed successfully. Jul 19 17:40:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-0877ce11-ca31-492c-a75f-41ef5ad40dd0 req-fa570aed-8380-4d27-96b6-97151c91e5c6 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "cinder-19fda458-774d-4219-936b-b8b93651357a-delete_snapshot" released by "delete_snapshot" :: held 1.600s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:24 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-b123da53-dbe9-4fae-be6b-0d0b2e0350ce tempest-GroupsV320Test-710388887 None] Created reservations ['079c4c71-c721-4d80-9407-b62154b3a0ab'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:40:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b123da53-dbe9-4fae-be6b-0d0b2e0350ce tempest-GroupsV320Test-710388887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b123da53-dbe9-4fae-be6b-0d0b2e0350ce tempest-GroupsV320Test-710388887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b123da53-dbe9-4fae-be6b-0d0b2e0350ce tempest-GroupsV320Test-710388887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b123da53-dbe9-4fae-be6b-0d0b2e0350ce tempest-GroupsV320Test-710388887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b123da53-dbe9-4fae-be6b-0d0b2e0350ce tempest-GroupsV320Test-710388887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b123da53-dbe9-4fae-be6b-0d0b2e0350ce tempest-GroupsV320Test-710388887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:25 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:40:25 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:25 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b123da53-dbe9-4fae-be6b-0d0b2e0350ce tempest-GroupsV320Test-710388887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.249s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:25 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-b123da53-dbe9-4fae-be6b-0d0b2e0350ce tempest-GroupsV320Test-710388887 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:40:25 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b123da53-dbe9-4fae-be6b-0d0b2e0350ce tempest-GroupsV320Test-710388887 None] Delete group completed successfully. Jul 19 17:40:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Acquiring lock "cinder-86ff38e3-5c20-4d64-81f2-d896816bfdb0-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "cinder-86ff38e3-5c20-4d64-81f2-d896816bfdb0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Acquiring lock "cinder-quobyte-86ff38e3-5c20-4d64-81f2-d896816bfdb0" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "cinder-quobyte-86ff38e3-5c20-4d64-81f2-d896816bfdb0" acquired by "delete_volume" :: waited 0.015s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:25 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[161f73de-f847-47f6-940d-3989b00d8999]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:25 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 Jul 19 17:40:25 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:25 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0" returned: 0 in 0.348s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:25 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0 Jul 19 17:40:25 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:26 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-86ff38e3-5c20-4d64-81f2-d896816bfdb0" returned: 0 in 0.243s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "cinder-quobyte-86ff38e3-5c20-4d64-81f2-d896816bfdb0" released by "delete_volume" :: held 0.660s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:26 devstack cinder-volume[87676]: DEBUG cinder.quota [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Created reservations ['69d77a1a-8627-460b-9c56-c03c41398900', 'f8f31d22-a8ec-4a48-8e60-681f61f1a8cc', '86b00c3a-d5fd-4f0f-b3af-9eca8388232d', 'a539d650-ceec-4e6c-ba3b-c2cf7e969204'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:40:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:26 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:40:26 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:26 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.260s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:26 devstack cinder-volume[87676]: DEBUG cinder.manager [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:40:26 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Deleted volume successfully. Jul 19 17:40:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-c43dc229-4c88-4a1e-a220-514f1a9632de req-a3678a76-4b02-4e80-9874-a209fe629e49 tempest-VolumesSnapshotsTestJSON-132430927 None] Lock "cinder-86ff38e3-5c20-4d64-81f2-d896816bfdb0-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:30 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:40:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Flow 'volume_create_manager' (b130862f-3f79-40a0-af40-bb733db97158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:40:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4e77ad-188d-44c7-8087-8d321a7367d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4e77ad-188d-44c7-8087-8d321a7367d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-679223434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41b6956-e789-4924-91a2-fd42b0320ec8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8bd51dd4b9f64428aaa44c3a0a9f6c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:40:31Z,use_quota=True,user_id='bad7bdfb73594bbea65aadb187c77df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190f2d38-767b-4a05-9327-94b581003f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190f2d38-767b-4a05-9327-94b581003f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ee5f2a-f0c2-4834-a806-3ef51a20e2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ee5f2a-f0c2-4834-a806-3ef51a20e2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b41b6956-e789-4924-91a2-fd42b0320ec8', 'volume_name': 'volume-b41b6956-e789-4924-91a2-fd42b0320ec8', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d23c014-3e11-48b8-97ad-dcacf80d4822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d23c014-3e11-48b8-97ad-dcacf80d4822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dff55f9-1949-4bb3-9344-7fabda65923e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:31 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Volume b41b6956-e789-4924-91a2-fd42b0320ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b41b6956-e789-4924-91a2-fd42b0320ec8', 'volume_size': 1} Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-679223434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41b6956-e789-4924-91a2-fd42b0320ec8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8bd51dd4b9f64428aaa44c3a0a9f6c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:40:31Z,use_quota=True,user_id='bad7bdfb73594bbea65aadb187c77df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Creating volume b41b6956-e789-4924-91a2-fd42b0320ec8 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:40:31 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b41b6956-e789-4924-91a2-fd42b0320ec8 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:31 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b41b6956-e789-4924-91a2-fd42b0320ec8 1073741824 Jul 19 17:40:31 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:31 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b41b6956-e789-4924-91a2-fd42b0320ec8 1073741824" returned: 0 in 0.663s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b41b6956-e789-4924-91a2-fd42b0320ec8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:31 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b41b6956-e789-4924-91a2-fd42b0320ec8 Jul 19 17:40:31 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:32 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b41b6956-e789-4924-91a2-fd42b0320ec8" returned: 0 in 0.386s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dff55f9-1949-4bb3-9344-7fabda65923e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b41b6956-e789-4924-91a2-fd42b0320ec8', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24c161d-ec0d-4055-9c10-deaee1852466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:32 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Volume volume-b41b6956-e789-4924-91a2-fd42b0320ec8 (b41b6956-e789-4924-91a2-fd42b0320ec8): created successfully Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24c161d-ec0d-4055-9c10-deaee1852466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Flow 'volume_create_manager' (b130862f-3f79-40a0-af40-bb733db97158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:40:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-0eced095-3c01-4a58-8b36-9c6924e65a9b req-910f5f1e-ed66-461f-9aa1-d414013325b5 tempest-VolumesGetTestJSON-1471423508 None] Created volume successfully. Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Flow 'volume_create_manager' (254f3a6c-e78d-46e0-8b09-074f171ebb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3027f832-e573-4dfb-a61b-e40eabb07e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3027f832-e573-4dfb-a61b-e40eabb07e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-115511452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d03260-ef34-4388-831e-dc69730025b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a870cb79ff347d09eba7e9c73bf9873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:40:32Z,use_quota=True,user_id='10ed18fa19fd44bc9a8b313e97f08343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c7a37f-1242-44d4-a0a0-2456270d826d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c7a37f-1242-44d4-a0a0-2456270d826d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2168f3-526d-4a9e-9dee-784d47e30c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2168f3-526d-4a9e-9dee-784d47e30c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20d03260-ef34-4388-831e-dc69730025b4', 'volume_name': 'volume-20d03260-ef34-4388-831e-dc69730025b4', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495cfce8-361f-4aea-a637-b9a6ec967227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495cfce8-361f-4aea-a637-b9a6ec967227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438fab85-701d-4081-901f-06c3ae7681ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:32 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Volume 20d03260-ef34-4388-831e-dc69730025b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20d03260-ef34-4388-831e-dc69730025b4', 'volume_size': 1} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-115511452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d03260-ef34-4388-831e-dc69730025b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a870cb79ff347d09eba7e9c73bf9873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:40:32Z,use_quota=True,user_id='10ed18fa19fd44bc9a8b313e97f08343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Creating volume 20d03260-ef34-4388-831e-dc69730025b4 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:40:32 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-20d03260-ef34-4388-831e-dc69730025b4 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:32 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-20d03260-ef34-4388-831e-dc69730025b4 1073741824 Jul 19 17:40:32 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:32 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-20d03260-ef34-4388-831e-dc69730025b4 1073741824" returned: 0 in 0.470s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-20d03260-ef34-4388-831e-dc69730025b4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:32 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-20d03260-ef34-4388-831e-dc69730025b4 Jul 19 17:40:32 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:33 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-20d03260-ef34-4388-831e-dc69730025b4" returned: 0 in 0.277s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:40:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438fab85-701d-4081-901f-06c3ae7681ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d03260-ef34-4388-831e-dc69730025b4', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a678af-6844-4535-aa2e-cad5997a345e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:33 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Volume volume-20d03260-ef34-4388-831e-dc69730025b4 (20d03260-ef34-4388-831e-dc69730025b4): created successfully Jul 19 17:40:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a678af-6844-4535-aa2e-cad5997a345e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Flow 'volume_create_manager' (254f3a6c-e78d-46e0-8b09-074f171ebb23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:40:33 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-edd44973-c2d5-480d-81ab-8faae304afd5 tempest-AttachVolumeNegativeTest-224058568 None] Created volume successfully. Jul 19 17:40:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Acquiring lock "cinder-b41b6956-e789-4924-91a2-fd42b0320ec8-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Lock "cinder-b41b6956-e789-4924-91a2-fd42b0320ec8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Acquiring lock "cinder-quobyte-b41b6956-e789-4924-91a2-fd42b0320ec8" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Lock "cinder-quobyte-b41b6956-e789-4924-91a2-fd42b0320ec8" acquired by "delete_volume" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:33 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[656b3c57-f663-45f0-a43b-e21f7b984c76]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b41b6956-e789-4924-91a2-fd42b0320ec8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:33 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b41b6956-e789-4924-91a2-fd42b0320ec8 Jul 19 17:40:33 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:34 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b41b6956-e789-4924-91a2-fd42b0320ec8" returned: 0 in 0.431s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b41b6956-e789-4924-91a2-fd42b0320ec8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:34 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b41b6956-e789-4924-91a2-fd42b0320ec8 Jul 19 17:40:34 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:34 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b41b6956-e789-4924-91a2-fd42b0320ec8" returned: 0 in 0.303s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Lock "cinder-quobyte-b41b6956-e789-4924-91a2-fd42b0320ec8" released by "delete_volume" :: held 0.801s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG cinder.quota [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Created reservations ['81694bc2-afc8-41f1-b694-23b06633a1fe', '683f755b-bff3-4f63-82ca-800eda7deeed', 'f0239f5a-f0a3-4e14-8936-56c18a1d7e25', 'e2b3cd36-421f-4c4e-a68f-0a7d7c1f4894'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:34 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:40:34 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:34 devstack sudo[94541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:40:34 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:35 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.361s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:35 devstack cinder-volume[87676]: DEBUG cinder.manager [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:40:35 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Deleted volume successfully. Jul 19 17:40:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-a81bf495-d902-45a1-a5e8-1f09af6c0e25 req-bb722868-f9b1-4a80-a79e-980c22b87258 tempest-VolumesGetTestJSON-1471423508 None] Lock "cinder-b41b6956-e789-4924-91a2-fd42b0320ec8-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:35 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.335s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:40:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:40:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 8 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:40:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:40:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-beef5838-78fb-40aa-9018-eec614cbba12 req-fbe60fca-8d0e-42ca-a2d9-6de562e50e25 tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-beef5838-78fb-40aa-9018-eec614cbba12 req-fbe60fca-8d0e-42ca-a2d9-6de562e50e25 tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-beef5838-78fb-40aa-9018-eec614cbba12 req-fbe60fca-8d0e-42ca-a2d9-6de562e50e25 tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-beef5838-78fb-40aa-9018-eec614cbba12 req-fbe60fca-8d0e-42ca-a2d9-6de562e50e25 tempest-AttachVolumeNegativeTest-224058568 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-20d03260-ef34-4388-831e-dc69730025b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe29bd72-3f85-4ef2-b556-411dc5811c99', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:40:36 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-beef5838-78fb-40aa-9018-eec614cbba12 req-fbe60fca-8d0e-42ca-a2d9-6de562e50e25 tempest-AttachVolumeNegativeTest-224058568 None] attachment_update completed successfully. Jul 19 17:40:38 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:40:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Flow 'volume_create_manager' (d36e92b5-c6ac-4c25-9d6b-6eff07b2afd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:40:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0e4f0b-408f-4cf5-a928-47a4b7063356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0e4f0b-408f-4cf5-a928-47a4b7063356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1797680533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0b6e4c-97ae-4fb0-9899-e14343fe31c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb54589f905443881f6193c8a46c6ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:40:39Z,use_quota=True,user_id='cd8a3bc26bbf486a92d042c84997812f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d0caaa4-4d93-49ad-947a-5a84d8ccc423),volume_type_id=2d0caaa4-4d93-49ad-947a-5a84d8ccc423)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fafda81-06f8-4372-9ee9-65ce18fd61db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fafda81-06f8-4372-9ee9-65ce18fd61db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7004d1dc-8d7f-428e-a8b1-0d05d6f9b377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7004d1dc-8d7f-428e-a8b1-0d05d6f9b377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a0b6e4c-97ae-4fb0-9899-e14343fe31c7', 'volume_name': 'volume-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333d584a-8a8b-4a3b-b767-4196127fc529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333d584a-8a8b-4a3b-b767-4196127fc529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28195682-ec5d-453e-ade1-7b376163ccf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:39 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Volume 4a0b6e4c-97ae-4fb0-9899-e14343fe31c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7', 'volume_size': 1} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1797680533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0b6e4c-97ae-4fb0-9899-e14343fe31c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb54589f905443881f6193c8a46c6ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:40:39Z,use_quota=True,user_id='cd8a3bc26bbf486a92d042c84997812f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d0caaa4-4d93-49ad-947a-5a84d8ccc423),volume_type_id=2d0caaa4-4d93-49ad-947a-5a84d8ccc423)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Creating volume 4a0b6e4c-97ae-4fb0-9899-e14343fe31c7 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:40:39 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:39 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7 1073741824 Jul 19 17:40:39 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-abe9038b-8380-4229-91d5-78709b0878ca req-2baa31d3-abed-4e73-81b4-c6ee661b0e2a tempest-AttachVolumeNegativeTest-224058568 None] Terminate volume connection completed successfully. Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-abe9038b-8380-4229-91d5-78709b0878ca req-2baa31d3-abed-4e73-81b4-c6ee661b0e2a tempest-AttachVolumeNegativeTest-224058568 None] Deleting attachment fe29bd72-3f85-4ef2-b556-411dc5811c99. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:40:39 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:39 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7 1073741824" returned: 0 in 0.586s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:39 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7 Jul 19 17:40:39 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:40 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7" returned: 0 in 0.369s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:40 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:40:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28195682-ec5d-453e-ade1-7b376163ccf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8130d732-0941-4d51-8cd6-c8ff982b64d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:40 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Volume volume-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7 (4a0b6e4c-97ae-4fb0-9899-e14343fe31c7): created successfully Jul 19 17:40:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8130d732-0941-4d51-8cd6-c8ff982b64d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Flow 'volume_create_manager' (d36e92b5-c6ac-4c25-9d6b-6eff07b2afd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:40:40 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ccda8e33-15bb-4bc4-9c2a-ca2951ebc6f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Created volume successfully. Jul 19 17:40:40 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8c66702f-c8f6-43ad-a403-cb7d4514d667 tempest-GroupSnapshotsV319Test-1347690692 None] Group tempest-GroupSnapshotsV319Test-Group-1373627670: creating Jul 19 17:40:40 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8c66702f-c8f6-43ad-a403-cb7d4514d667 tempest-GroupSnapshotsV319Test-1347690692 None] Group tempest-GroupSnapshotsV319Test-Group-1373627670: created successfully Jul 19 17:40:40 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8c66702f-c8f6-43ad-a403-cb7d4514d667 tempest-GroupSnapshotsV319Test-1347690692 None] Create group completed successfully. Jul 19 17:40:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-93c9a110-4adc-473b-a58e-1d03b79c1e74 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-93c9a110-4adc-473b-a58e-1d03b79c1e74 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:41 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-93c9a110-4adc-473b-a58e-1d03b79c1e74 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:41 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-93c9a110-4adc-473b-a58e-1d03b79c1e74 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-93c9a110-4adc-473b-a58e-1d03b79c1e74 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-93c9a110-4adc-473b-a58e-1d03b79c1e74 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:41 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:40:41 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:42 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-93c9a110-4adc-473b-a58e-1d03b79c1e74 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.381s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-93c9a110-4adc-473b-a58e-1d03b79c1e74 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:40:42 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-93c9a110-4adc-473b-a58e-1d03b79c1e74 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Retype volume completed successfully. Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Flow 'volume_create_manager' (898d26e0-08f4-4aac-8b96-fd377733ad27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387dffe0-f35f-456d-9430-e420bb1632df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387dffe0-f35f-456d-9430-e420bb1632df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-3316094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a26b2360-d9de-4971-889a-66b8a6d71f9f,host='devstack@QuobyteHD#QuobyteHD',id=cd94169d-56f3-4280-af03-b0441ab9b91d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddb3629e9a04a769a337350d8f6b458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:40:43Z,use_quota=True,user_id='48f5114e0f094ac99184b76223cd2d25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f2a8469-9f7b-48b2-ac55-5f0eecebcded),volume_type_id=5f2a8469-9f7b-48b2-ac55-5f0eecebcded)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1251cf03-104e-4997-afea-d3e998c64e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1251cf03-104e-4997-afea-d3e998c64e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea340528-a235-4905-83c1-ab641ed1a44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea340528-a235-4905-83c1-ab641ed1a44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd94169d-56f3-4280-af03-b0441ab9b91d', 'volume_name': 'volume-cd94169d-56f3-4280-af03-b0441ab9b91d', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab60b72-93a5-4b8c-9418-e6ccff3b19cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab60b72-93a5-4b8c-9418-e6ccff3b19cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d695ef1f-14eb-4712-bb49-5b790406fc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:42 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Volume cd94169d-56f3-4280-af03-b0441ab9b91d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd94169d-56f3-4280-af03-b0441ab9b91d', 'volume_size': 1} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a26b2360-d9de-4971-889a-66b8a6d71f9f,created_at=2026-07-19T15:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-3316094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a26b2360-d9de-4971-889a-66b8a6d71f9f,host='devstack@QuobyteHD#QuobyteHD',id=cd94169d-56f3-4280-af03-b0441ab9b91d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddb3629e9a04a769a337350d8f6b458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:40:43Z,use_quota=True,user_id='48f5114e0f094ac99184b76223cd2d25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f2a8469-9f7b-48b2-ac55-5f0eecebcded),volume_type_id=5f2a8469-9f7b-48b2-ac55-5f0eecebcded)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Creating volume cd94169d-56f3-4280-af03-b0441ab9b91d {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:40:42 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:40:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:42 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d 1073741824 Jul 19 17:40:42 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:43 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Acquiring lock "cinder-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:43 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Lock "cinder-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:43 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Acquiring lock "cinder-quobyte-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:43 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Lock "cinder-quobyte-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7" acquired by "delete_volume" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:43 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cafb125-b31e-4852-ac3b-93d72f5cb894]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:43 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7 Jul 19 17:40:43 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:43 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d 1073741824" returned: 0 in 0.578s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:43 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d Jul 19 17:40:43 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:43 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7" returned: 0 in 0.517s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:43 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7 Jul 19 17:40:43 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:43 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d" returned: 0 in 0.415s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:40:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d695ef1f-14eb-4712-bb49-5b790406fc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd94169d-56f3-4280-af03-b0441ab9b91d', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e188b4-d738-4edd-abcf-09fb7647e651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:44 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Volume volume-cd94169d-56f3-4280-af03-b0441ab9b91d (cd94169d-56f3-4280-af03-b0441ab9b91d): created successfully Jul 19 17:40:44 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e188b4-d738-4edd-abcf-09fb7647e651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Flow 'volume_create_manager' (898d26e0-08f4-4aac-8b96-fd377733ad27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7" returned: 0 in 0.343s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Lock "cinder-quobyte-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7" released by "delete_volume" :: held 0.920s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:44 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f2c397f3-546c-4240-8143-cea1ea3eb6f9 tempest-GroupSnapshotsV319Test-1347690692 None] Created volume successfully. Jul 19 17:40:44 devstack cinder-volume[87676]: WARNING cinder.quota [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:40:44 devstack cinder-volume[87676]: WARNING cinder.quota [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Created reservations ['d24abcac-c6a3-4b83-8dd8-013c41cc7c8a', '699b45df-c5e0-4975-a79a-613f6fc91893', 'fd002b2f-5e38-4398-b02a-be41e9526576', 'a222fc7e-12dd-494d-bed1-f45c9332684e'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:44 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:40:44 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:44 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.280s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:40:44 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Deleted volume successfully. Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-81a6298f-ca05-4c10-8b01-81111da996f7 tempest-VolumeRetypeWithoutMigrationTest-386988765 None] Lock "cinder-4a0b6e4c-97ae-4fb0-9899-e14343fe31c7-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "cinder-20d03260-ef34-4388-831e-dc69730025b4-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Lock "cinder-20d03260-ef34-4388-831e-dc69730025b4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "cinder-quobyte-20d03260-ef34-4388-831e-dc69730025b4" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Lock "cinder-quobyte-20d03260-ef34-4388-831e-dc69730025b4" acquired by "delete_volume" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5fe39f-7089-48bc-9eb7-641c6d90345e]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-20d03260-ef34-4388-831e-dc69730025b4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:44 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-20d03260-ef34-4388-831e-dc69730025b4 Jul 19 17:40:44 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:45 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-20d03260-ef34-4388-831e-dc69730025b4" returned: 0 in 0.785s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-20d03260-ef34-4388-831e-dc69730025b4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:45 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-20d03260-ef34-4388-831e-dc69730025b4 Jul 19 17:40:45 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:45 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] GroupSnapshot d8aac082-2a08-480c-af8f-0d64ac8df738: creating. Jul 19 17:40:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] Group snapshot d8aac082-2a08-480c-af8f-0d64ac8df738: creating. {{(pid=87676) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 19 17:40:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] Creating offline snapshot 9e0106a1-bbf6-4812-8f8f-86ab478f0518 of volume cd94169d-56f3-4280-af03-b0441ab9b91d {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:40:46 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a725b29-acd9-45ad-b40a-200a1cd55993]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:46 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-20d03260-ef34-4388-831e-dc69730025b4" returned: 0 in 0.710s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Lock "cinder-quobyte-20d03260-ef34-4388-831e-dc69730025b4" released by "delete_volume" :: held 1.579s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:46 devstack sudo[95146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d Jul 19 17:40:46 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:46 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Created reservations ['5f8e45b2-ddb3-46f0-b85b-3a263db46cce', '3a9796e3-2ab7-4341-8611-e50e00186e4e', '2013a7f5-4f07-4afc-ba20-5a0ad800a84f', 'a7a4b69d-9b64-4aa5-bd01-0388ec9c1dd1'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:40:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:46 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:40:46 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:46 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d" returned: 0 in 0.653s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:46 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518 1G Jul 19 17:40:46 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:47 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.527s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:47 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:40:47 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Deleted volume successfully. Jul 19 17:40:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-289d0c83-d40a-40dd-b42f-7826dc11dadb tempest-AttachVolumeNegativeTest-224058568 None] Lock "cinder-20d03260-ef34-4388-831e-dc69730025b4-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "cinder-64e6d53c-dc91-4053-8861-c4ce92ccee1b-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Lock "cinder-64e6d53c-dc91-4053-8861-c4ce92ccee1b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "cinder-quobyte-64e6d53c-dc91-4053-8861-c4ce92ccee1b" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Lock "cinder-quobyte-64e6d53c-dc91-4053-8861-c4ce92ccee1b" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:47 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a68933-7b47-4e8b-b87e-da2f45529b18]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:47 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518 1G" returned: 0 in 0.914s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd94169d-56f3-4280-af03-b0441ab9b91d -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:47 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b Jul 19 17:40:47 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:47 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd94169d-56f3-4280-af03-b0441ab9b91d -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518 Jul 19 17:40:47 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:48 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b" returned: 0 in 0.496s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:48 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b Jul 19 17:40:48 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:48 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd94169d-56f3-4280-af03-b0441ab9b91d -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518" returned: 0 in 0.461s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:48 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518 is being set with open permissions: ugo+rw: NotImplementedError Jul 19 17:40:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:48 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518 Jul 19 17:40:48 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:48 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518" returned: 0 in 0.320s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:48 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-64e6d53c-dc91-4053-8861-c4ce92ccee1b" returned: 0 in 0.516s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:48 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.info Jul 19 17:40:48 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:48 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Lock "cinder-quobyte-64e6d53c-dc91-4053-8861-c4ce92ccee1b" released by "delete_volume" :: held 1.076s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:48 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Created reservations ['26e7104e-35e6-47c6-9596-3c9457430de0', '88aa1e10-47a9-489d-a4d2-8990f7c0cf5a', '05c0391a-c06f-4179-9330-789fe9583795', '530f5e80-d939-485a-83ca-4c08a2d6de48'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:40:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:48 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:40:48 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:49 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.info" returned: 0 in 0.598s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:49 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 19 17:40:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:49 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.info Jul 19 17:40:49 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:49 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.491s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:49 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:40:49 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Deleted volume successfully. Jul 19 17:40:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-66e7ecdc-f54e-4936-80ad-6dd1b287c7fd tempest-AttachVolumeNegativeTest-224058568 None] Lock "cinder-64e6d53c-dc91-4053-8861-c4ce92ccee1b-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:49 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.info" returned: 0 in 0.461s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.618s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:49 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-011260cc-14ac-4dd8-92a4-d409d0be85ab tempest-GroupSnapshotsV319Test-1347690692 None] group_snapshot d8aac082-2a08-480c-af8f-0d64ac8df738: created successfully Jul 19 17:40:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "cinder-eefaea28-aad0-4e85-90c5-16024fe6d600-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Lock "cinder-eefaea28-aad0-4e85-90c5-16024fe6d600-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "cinder-quobyte-eefaea28-aad0-4e85-90c5-16024fe6d600" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Lock "cinder-quobyte-eefaea28-aad0-4e85-90c5-16024fe6d600" acquired by "delete_volume" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:50 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01c0d69-ff1e-4ad6-93f7-21f49d092867]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eefaea28-aad0-4e85-90c5-16024fe6d600 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:50 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eefaea28-aad0-4e85-90c5-16024fe6d600 Jul 19 17:40:50 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:50 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eefaea28-aad0-4e85-90c5-16024fe6d600" returned: 0 in 0.619s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eefaea28-aad0-4e85-90c5-16024fe6d600 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:51 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eefaea28-aad0-4e85-90c5-16024fe6d600 Jul 19 17:40:51 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:51 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] group_snapshot d8aac082-2a08-480c-af8f-0d64ac8df738: deleting Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=100,cinder:UPDATE=117,cinder:INSERT=28,cinder:DELETE=7 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:UPDATE=108,cinder:SELECT=113,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] group_snapshot d8aac082-2a08-480c-af8f-0d64ac8df738: deleting {{(pid=87676) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] Acquiring lock "cinder-quobyte-cd94169d-56f3-4280-af03-b0441ab9b91d" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] Lock "cinder-quobyte-cd94169d-56f3-4280-af03-b0441ab9b91d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] Acquiring lock "cinder-quobyte-9e0106a1-bbf6-4812-8f8f-86ab478f0518" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] Lock "cinder-quobyte-9e0106a1-bbf6-4812-8f8f-86ab478f0518" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] Deleting offline snapshot 9e0106a1-bbf6-4812-8f8f-86ab478f0518 of volume cd94169d-56f3-4280-af03-b0441ab9b91d {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] snapshot_file for this snap is: volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9386834-4365-4d4d-82e5-cba68f284c80]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:51 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518 Jul 19 17:40:51 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:51 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eefaea28-aad0-4e85-90c5-16024fe6d600" returned: 0 in 0.506s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Lock "cinder-quobyte-eefaea28-aad0-4e85-90c5-16024fe6d600" released by "delete_volume" :: held 1.215s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Created reservations ['dc203697-b2af-4b55-815b-911ea44882b1', 'c8cb7500-d1f2-4287-b7f1-e2afd2594bfe', '18cb7ead-14be-4b23-b5dd-ce241021e3cc', '39e756cc-4661-48e5-b958-ac40ce7124f4'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:51 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:40:51 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:51 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518" returned: 0 in 0.623s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd94169d-56f3-4280-af03-b0441ab9b91d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1535ffa-3028-4615-969d-4c482d20844c]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:52 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d Jul 19 17:40:52 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:52 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.355s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:52 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:40:52 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Deleted volume successfully. Jul 19 17:40:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7fb836ef-90e8-43b9-91f6-6279069f99a3 tempest-AttachVolumeNegativeTest-224058568 None] Lock "cinder-eefaea28-aad0-4e85-90c5-16024fe6d600-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:52 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d" returned: 0 in 0.488s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:52 devstack sudo[95219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518 Jul 19 17:40:52 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:52 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518" returned: 0 in 0.457s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:52 devstack sudo[95226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518 Jul 19 17:40:52 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:53 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d.9e0106a1-bbf6-4812-8f8f-86ab478f0518" returned: 0 in 0.308s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] Lock "cinder-quobyte-9e0106a1-bbf6-4812-8f8f-86ab478f0518" released by "_delete_snapshot" :: held 2.036s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] Lock "cinder-quobyte-cd94169d-56f3-4280-af03-b0441ab9b91d" released by "delete_snapshot" :: held 2.074s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:53 devstack cinder-volume[87676]: WARNING cinder.quota [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-448301769 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-448301769, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:40:53 devstack cinder-volume[87676]: WARNING cinder.quota [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-448301769 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-448301769, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:40:53 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] Created reservations ['1af0b8e9-82c1-4fb9-8836-7f0611879467', '91e9bad1-de6e-444e-a127-88e9a2a78e10', '5f3bd18d-a302-4249-b468-c894cc873b0e', '6ac1273d-a21a-44ed-8fda-15162f88d4ff'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:40:53 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a9236b4e-41ae-4a19-8c7d-fa2047d8c6b3 tempest-GroupSnapshotsV319Test-1347690692 None] group_snapshot d8aac082-2a08-480c-af8f-0d64ac8df738: deleted successfully Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Flow 'volume_create_manager' (189d416a-33f1-4204-9893-3c4df7abe035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23874fcd-4d47-4f7a-b2a4-be15ebda376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23874fcd-4d47-4f7a-b2a4-be15ebda376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-922641552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321e7480-09c4-459a-b629-f9ee8be7e28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a4776c0a73e42ababc9c685e815abd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:40:55Z,use_quota=True,user_id='9f0e356d0ad24135b6d88d2da8689356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72eb002b-6e52-4b9f-ad78-3c2ccb3e077a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72eb002b-6e52-4b9f-ad78-3c2ccb3e077a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6917caa0-cde4-4025-b1db-5fb37a8b87d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6917caa0-cde4-4025-b1db-5fb37a8b87d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '321e7480-09c4-459a-b629-f9ee8be7e28a', 'volume_name': 'volume-321e7480-09c4-459a-b629-f9ee8be7e28a', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7947cc92-3ac5-4568-bdb3-069bf97b87b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7947cc92-3ac5-4568-bdb3-069bf97b87b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3cc2de-38c7-46d4-8de4-82803f194f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:54 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Volume 321e7480-09c4-459a-b629-f9ee8be7e28a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-321e7480-09c4-459a-b629-f9ee8be7e28a', 'volume_size': 1} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-922641552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321e7480-09c4-459a-b629-f9ee8be7e28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a4776c0a73e42ababc9c685e815abd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:40:55Z,use_quota=True,user_id='9f0e356d0ad24135b6d88d2da8689356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Creating volume 321e7480-09c4-459a-b629-f9ee8be7e28a {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:40:54 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-321e7480-09c4-459a-b629-f9ee8be7e28a 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:54 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-321e7480-09c4-459a-b629-f9ee8be7e28a 1073741824 Jul 19 17:40:54 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] Acquiring lock "cinder-quobyte-cd94169d-56f3-4280-af03-b0441ab9b91d" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] Lock "cinder-quobyte-cd94169d-56f3-4280-af03-b0441ab9b91d" acquired by "delete_volume" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:55 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[395f419a-5ca8-4505-b367-d614d5c6fc10]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:55 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d Jul 19 17:40:55 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:55 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-321e7480-09c4-459a-b629-f9ee8be7e28a 1073741824" returned: 0 in 0.576s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-321e7480-09c4-459a-b629-f9ee8be7e28a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:55 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-321e7480-09c4-459a-b629-f9ee8be7e28a Jul 19 17:40:55 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:55 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d" returned: 0 in 0.560s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:55 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d Jul 19 17:40:55 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:55 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-321e7480-09c4-459a-b629-f9ee8be7e28a" returned: 0 in 0.387s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:40:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3cc2de-38c7-46d4-8de4-82803f194f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-321e7480-09c4-459a-b629-f9ee8be7e28a', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5baf06e5-b013-4259-ad05-a0b3802fa9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:40:55 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Volume volume-321e7480-09c4-459a-b629-f9ee8be7e28a (321e7480-09c4-459a-b629-f9ee8be7e28a): created successfully Jul 19 17:40:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5baf06e5-b013-4259-ad05-a0b3802fa9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:40:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Flow 'volume_create_manager' (189d416a-33f1-4204-9893-3c4df7abe035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:40:55 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-43dfcd4e-ceb5-47f8-9a97-0442448b59fa tempest-VolumesServicesTestJSON-1240408544 None] Created volume successfully. Jul 19 17:40:55 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cd94169d-56f3-4280-af03-b0441ab9b91d" returned: 0 in 0.391s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] Lock "cinder-quobyte-cd94169d-56f3-4280-af03-b0441ab9b91d" released by "delete_volume" :: held 1.038s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:56 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] Created reservations ['f1f1c3c1-5ffd-40e6-9ada-4eb13ec9f51e'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:40:56 devstack cinder-volume[87676]: WARNING cinder.quota [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-448301769 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-448301769, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:40:56 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] Created reservations ['2680e338-3bda-450a-93e9-062d436c58b9', '67226d7d-ce24-48ca-a054-1b6b4f68c26c', '562b7be5-9449-4d39-ba3b-80d2ca3ce502', '63a47148-2f9d-470d-a45b-cdea4b44b20c'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:40:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:56 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:40:56 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:56 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.280s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:56 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:40:56 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-7bc74c0f-b22a-414d-9975-ab521df51a38 tempest-GroupSnapshotsV319Test-1347690692 None] Delete group completed successfully. Jul 19 17:40:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Acquiring lock "cinder-321e7480-09c4-459a-b629-f9ee8be7e28a-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Lock "cinder-321e7480-09c4-459a-b629-f9ee8be7e28a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Acquiring lock "cinder-quobyte-321e7480-09c4-459a-b629-f9ee8be7e28a" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:40:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Lock "cinder-quobyte-321e7480-09c4-459a-b629-f9ee8be7e28a" acquired by "delete_volume" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:40:57 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06da618-57f3-407e-9562-cf869738c098]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:40:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-321e7480-09c4-459a-b629-f9ee8be7e28a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:57 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-321e7480-09c4-459a-b629-f9ee8be7e28a Jul 19 17:40:57 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:57 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-321e7480-09c4-459a-b629-f9ee8be7e28a" returned: 0 in 0.512s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-321e7480-09c4-459a-b629-f9ee8be7e28a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:57 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-321e7480-09c4-459a-b629-f9ee8be7e28a Jul 19 17:40:57 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:57 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-321e7480-09c4-459a-b629-f9ee8be7e28a" returned: 0 in 0.389s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Lock "cinder-quobyte-321e7480-09c4-459a-b629-f9ee8be7e28a" released by "delete_volume" :: held 0.977s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:40:58 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Created reservations ['6533c326-bbab-4425-8157-4dd9272fb06b', '20656a12-e7a9-445f-a7e0-eec7793eb84f', '60cec989-4b0a-46e8-aeae-15ead42c4588', '9c2ca057-2d7d-4743-b869-ac1e106c0638'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:40:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:40:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:40:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:40:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:40:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:40:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:40:58 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:40:58 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:40:58 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Jul 19 17:40:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.404s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:40:58 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:40:58 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Deleted volume successfully. Jul 19 17:40:58 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-293febbe-bc82-4d79-a483-e92a0e8bb964 tempest-VolumesServicesTestJSON-1240408544 None] Lock "cinder-321e7480-09c4-459a-b629-f9ee8be7e28a-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-037440ad-e447-4c1c-89d9-6fe16253c20a tempest-BackendsCapabilitiesAdminTestsJSON-2113455127 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87676) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 19 17:41:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a5182321-856b-47ab-acc7-a7339de8bdf3 tempest-BackendsCapabilitiesAdminTestsJSON-2113455127 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87676) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 19 17:41:08 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=28,cinder:INSERT=12,cinder:UPDATE=35,cinder:DELETE=1 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:41:08 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=23,cinder:INSERT=6,cinder:UPDATE=36,cinder:DELETE=2 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Flow 'volume_create_manager' (937d422b-acd3-417c-b722-d6bd5cc8341c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd93207-0bd7-475e-8a80-9fb2e8cf4f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd93207-0bd7-475e-8a80-9fb2e8cf4f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-754408577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45418f6b-e24a-466f-8d18-315bd088282f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28818042379c4d559eb0e471a6ceb4b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:11Z,use_quota=True,user_id='910c4f3f32214111b4ecf65618932db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05211086-374f-4fe8-bd7a-3671a544092b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05211086-374f-4fe8-bd7a-3671a544092b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97157805-b39a-49dd-a088-dc9f7d1a0c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97157805-b39a-49dd-a088-dc9f7d1a0c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45418f6b-e24a-466f-8d18-315bd088282f', 'volume_name': 'volume-45418f6b-e24a-466f-8d18-315bd088282f', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45ff345-98dc-4e3b-bab8-61dced2e178c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45ff345-98dc-4e3b-bab8-61dced2e178c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad11ef3-b566-42f3-b58e-692ea314e028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:11 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Volume 45418f6b-e24a-466f-8d18-315bd088282f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45418f6b-e24a-466f-8d18-315bd088282f', 'volume_size': 1} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-754408577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45418f6b-e24a-466f-8d18-315bd088282f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28818042379c4d559eb0e471a6ceb4b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:11Z,use_quota=True,user_id='910c4f3f32214111b4ecf65618932db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Creating volume 45418f6b-e24a-466f-8d18-315bd088282f {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:41:11 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:41:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-45418f6b-e24a-466f-8d18-315bd088282f 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:11 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-45418f6b-e24a-466f-8d18-315bd088282f 1073741824 Jul 19 17:41:11 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:12 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-45418f6b-e24a-466f-8d18-315bd088282f 1073741824" returned: 0 in 0.567s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-45418f6b-e24a-466f-8d18-315bd088282f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:12 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-45418f6b-e24a-466f-8d18-315bd088282f Jul 19 17:41:12 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:12 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-45418f6b-e24a-466f-8d18-315bd088282f" returned: 0 in 0.297s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:41:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad11ef3-b566-42f3-b58e-692ea314e028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45418f6b-e24a-466f-8d18-315bd088282f', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7eaa1d-49cb-4352-94d7-13f284e3d193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:12 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Volume volume-45418f6b-e24a-466f-8d18-315bd088282f (45418f6b-e24a-466f-8d18-315bd088282f): created successfully Jul 19 17:41:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7eaa1d-49cb-4352-94d7-13f284e3d193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Flow 'volume_create_manager' (937d422b-acd3-417c-b722-d6bd5cc8341c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:12 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a9d8c16b-954d-4318-9a88-59961542a1c7 tempest-AttachVolumeTestJSON-374548148 None] Created volume successfully. Jul 19 17:41:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-fde80992-33cc-4f2d-8ef2-82582b1e2096 req-a36c1784-6555-4913-82b2-a5b4d997367e tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-fde80992-33cc-4f2d-8ef2-82582b1e2096 req-a36c1784-6555-4913-82b2-a5b4d997367e tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-fde80992-33cc-4f2d-8ef2-82582b1e2096 req-a36c1784-6555-4913-82b2-a5b4d997367e tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-fde80992-33cc-4f2d-8ef2-82582b1e2096 req-a36c1784-6555-4913-82b2-a5b4d997367e tempest-AttachVolumeTestJSON-374548148 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-45418f6b-e24a-466f-8d18-315bd088282f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bf545f8-0fcd-4381-a7d0-9b5700ed617d', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:41:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-fde80992-33cc-4f2d-8ef2-82582b1e2096 req-a36c1784-6555-4913-82b2-a5b4d997367e tempest-AttachVolumeTestJSON-374548148 None] attachment_update completed successfully. Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Flow 'volume_create_manager' (64cf79f6-752b-4a1c-8324-bf64c4d1815d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4dd29fa-4830-4b29-8a5e-fb2acc009048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4dd29fa-4830-4b29-8a5e-fb2acc009048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-636691422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=633c8a34-3703-4c17-b6eb-f5a1577d7735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28818042379c4d559eb0e471a6ceb4b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:18Z,use_quota=True,user_id='910c4f3f32214111b4ecf65618932db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c53891-1ca5-46f8-a723-579f4c8c59be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c53891-1ca5-46f8-a723-579f4c8c59be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e607422-115f-41b1-b831-d7efcc37084f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e607422-115f-41b1-b831-d7efcc37084f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '633c8a34-3703-4c17-b6eb-f5a1577d7735', 'volume_name': 'volume-633c8a34-3703-4c17-b6eb-f5a1577d7735', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb57a8f-7528-4add-b5bb-e77e374db8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb57a8f-7528-4add-b5bb-e77e374db8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb02902-833d-4138-8261-2959744dddf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:17 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Volume 633c8a34-3703-4c17-b6eb-f5a1577d7735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-633c8a34-3703-4c17-b6eb-f5a1577d7735', 'volume_size': 1} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-636691422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=633c8a34-3703-4c17-b6eb-f5a1577d7735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28818042379c4d559eb0e471a6ceb4b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:18Z,use_quota=True,user_id='910c4f3f32214111b4ecf65618932db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Creating volume 633c8a34-3703-4c17-b6eb-f5a1577d7735 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:41:17 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:41:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-633c8a34-3703-4c17-b6eb-f5a1577d7735 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:17 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-633c8a34-3703-4c17-b6eb-f5a1577d7735 1073741824 Jul 19 17:41:17 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:18 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-633c8a34-3703-4c17-b6eb-f5a1577d7735 1073741824" returned: 0 in 0.620s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-633c8a34-3703-4c17-b6eb-f5a1577d7735 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:18 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-633c8a34-3703-4c17-b6eb-f5a1577d7735 Jul 19 17:41:18 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:18 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-633c8a34-3703-4c17-b6eb-f5a1577d7735" returned: 0 in 0.376s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:41:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb02902-833d-4138-8261-2959744dddf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-633c8a34-3703-4c17-b6eb-f5a1577d7735', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61b6446-bea9-49d3-bc2e-9f9af91d1ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:18 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Volume volume-633c8a34-3703-4c17-b6eb-f5a1577d7735 (633c8a34-3703-4c17-b6eb-f5a1577d7735): created successfully Jul 19 17:41:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61b6446-bea9-49d3-bc2e-9f9af91d1ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Flow 'volume_create_manager' (64cf79f6-752b-4a1c-8324-bf64c4d1815d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:18 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8ca199ec-5287-4c7b-8255-f6dca49018c0 tempest-AttachVolumeTestJSON-374548148 None] Created volume successfully. Jul 19 17:41:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-b1d75865-285f-4ee4-ae09-99f73e8b33b1 req-8b1efdbe-8215-4d98-9584-8b3313c54780 tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-b1d75865-285f-4ee4-ae09-99f73e8b33b1 req-8b1efdbe-8215-4d98-9584-8b3313c54780 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-b1d75865-285f-4ee4-ae09-99f73e8b33b1 req-8b1efdbe-8215-4d98-9584-8b3313c54780 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-b1d75865-285f-4ee4-ae09-99f73e8b33b1 req-8b1efdbe-8215-4d98-9584-8b3313c54780 tempest-AttachVolumeTestJSON-374548148 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-633c8a34-3703-4c17-b6eb-f5a1577d7735', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c356afc-350f-45ae-ac6e-9fa6de1160aa', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:41:21 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-b1d75865-285f-4ee4-ae09-99f73e8b33b1 req-8b1efdbe-8215-4d98-9584-8b3313c54780 tempest-AttachVolumeTestJSON-374548148 None] attachment_update completed successfully. Jul 19 17:41:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-63d78ca4-3f52-4e2a-9191-9d15d87aac49 req-6c45a772-b6a7-44ea-85c2-d1c3fb75fce1 tempest-AttachVolumeTestJSON-374548148 None] Terminate volume connection completed successfully. Jul 19 17:41:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-63d78ca4-3f52-4e2a-9191-9d15d87aac49 req-6c45a772-b6a7-44ea-85c2-d1c3fb75fce1 tempest-AttachVolumeTestJSON-374548148 None] Deleting attachment 7bf545f8-0fcd-4381-a7d0-9b5700ed617d. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:41:24 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-bb711d53-93b5-43bd-a10d-8d07db3dd704 req-e30e4712-0b2e-43ee-a25f-f8489ea6b542 tempest-AttachVolumeTestJSON-374548148 None] Terminate volume connection completed successfully. Jul 19 17:41:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-bb711d53-93b5-43bd-a10d-8d07db3dd704 req-e30e4712-0b2e-43ee-a25f-f8489ea6b542 tempest-AttachVolumeTestJSON-374548148 None] Deleting attachment 2c356afc-350f-45ae-ac6e-9fa6de1160aa. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Flow 'volume_create_manager' (f31d3304-30a0-4c68-b428-0ed2d12eb301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b9d3bd-b654-47a2-9dfe-a0269170434a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b9d3bd-b654-47a2-9dfe-a0269170434a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-408167620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95da442e-7993-4ddf-b0b1-e30c352a283e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3ede95414a4107b5ffc79fe80828ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:25Z,use_quota=True,user_id='d1d0082eab1b4e7bafd5e983384ccfe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04063d02-89f9-4ba4-ab99-ff36919fcb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04063d02-89f9-4ba4-ab99-ff36919fcb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ecf66c-137f-4665-a2fa-389b4dde63db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ecf66c-137f-4665-a2fa-389b4dde63db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95da442e-7993-4ddf-b0b1-e30c352a283e', 'volume_name': 'volume-95da442e-7993-4ddf-b0b1-e30c352a283e', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c0296b-02c0-4742-9693-c5a0fd9ff7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c0296b-02c0-4742-9693-c5a0fd9ff7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea838c4-e919-458c-b2f0-8703a9e82b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:25 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Volume 95da442e-7993-4ddf-b0b1-e30c352a283e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95da442e-7993-4ddf-b0b1-e30c352a283e', 'volume_size': 1} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-408167620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95da442e-7993-4ddf-b0b1-e30c352a283e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3ede95414a4107b5ffc79fe80828ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:25Z,use_quota=True,user_id='d1d0082eab1b4e7bafd5e983384ccfe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Creating volume 95da442e-7993-4ddf-b0b1-e30c352a283e {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:41:25 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-95da442e-7993-4ddf-b0b1-e30c352a283e 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:25 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-95da442e-7993-4ddf-b0b1-e30c352a283e 1073741824 Jul 19 17:41:25 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:25 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-95da442e-7993-4ddf-b0b1-e30c352a283e 1073741824" returned: 0 in 0.767s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-95da442e-7993-4ddf-b0b1-e30c352a283e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:26 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-95da442e-7993-4ddf-b0b1-e30c352a283e Jul 19 17:41:26 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:26 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-95da442e-7993-4ddf-b0b1-e30c352a283e" returned: 0 in 0.355s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:41:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea838c4-e919-458c-b2f0-8703a9e82b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95da442e-7993-4ddf-b0b1-e30c352a283e', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec17896-9168-49b3-8509-a78f54d7fee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:26 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Volume volume-95da442e-7993-4ddf-b0b1-e30c352a283e (95da442e-7993-4ddf-b0b1-e30c352a283e): created successfully Jul 19 17:41:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec17896-9168-49b3-8509-a78f54d7fee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Flow 'volume_create_manager' (f31d3304-30a0-4c68-b428-0ed2d12eb301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:26 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-0db49147-9992-48c7-a832-6bf302264615 tempest-VolumeQuotasNegativeTestJSON-433905837 None] Created volume successfully. Jul 19 17:41:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Acquiring lock "cinder-95da442e-7993-4ddf-b0b1-e30c352a283e-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Lock "cinder-95da442e-7993-4ddf-b0b1-e30c352a283e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Acquiring lock "cinder-quobyte-95da442e-7993-4ddf-b0b1-e30c352a283e" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Lock "cinder-quobyte-95da442e-7993-4ddf-b0b1-e30c352a283e" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:28 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[020e388f-4fde-48ed-aea8-ef3222a274b3]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:41:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-95da442e-7993-4ddf-b0b1-e30c352a283e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:28 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-95da442e-7993-4ddf-b0b1-e30c352a283e Jul 19 17:41:28 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:28 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-95da442e-7993-4ddf-b0b1-e30c352a283e" returned: 0 in 0.499s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-95da442e-7993-4ddf-b0b1-e30c352a283e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:29 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-95da442e-7993-4ddf-b0b1-e30c352a283e Jul 19 17:41:29 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:29 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-95da442e-7993-4ddf-b0b1-e30c352a283e" returned: 0 in 0.309s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Lock "cinder-quobyte-95da442e-7993-4ddf-b0b1-e30c352a283e" released by "delete_volume" :: held 0.860s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:29 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Created reservations ['8dc3b1c6-551e-45c3-8b34-c99f7c18fa61', '407cb77d-9bb0-41f4-9abd-1d736e07e8de', '6ef67409-bad2-4633-ae73-d3631cb4ea35', '44fbdad1-d021-4564-bf5a-ec2b8c11c373'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:41:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:29 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:41:29 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:41:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:29 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:41:29 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:29 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.431s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:29 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:41:29 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Deleted volume successfully. Jul 19 17:41:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3b114156-ded5-4067-9d79-860044b7a04d tempest-VolumeQuotasNegativeTestJSON-433905837 None] Lock "cinder-95da442e-7993-4ddf-b0b1-e30c352a283e-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "cinder-633c8a34-3703-4c17-b6eb-f5a1577d7735-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Lock "cinder-633c8a34-3703-4c17-b6eb-f5a1577d7735-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "cinder-quobyte-633c8a34-3703-4c17-b6eb-f5a1577d7735" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Lock "cinder-quobyte-633c8a34-3703-4c17-b6eb-f5a1577d7735" acquired by "delete_volume" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:34 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fddd1c-b6ab-4561-b8f0-e923e737ffab]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:41:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-633c8a34-3703-4c17-b6eb-f5a1577d7735 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:34 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-633c8a34-3703-4c17-b6eb-f5a1577d7735 Jul 19 17:41:34 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:34 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-633c8a34-3703-4c17-b6eb-f5a1577d7735" returned: 0 in 0.533s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-633c8a34-3703-4c17-b6eb-f5a1577d7735 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:34 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-633c8a34-3703-4c17-b6eb-f5a1577d7735 Jul 19 17:41:34 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:41:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:41:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:41:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:34 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:41:34 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:35 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-633c8a34-3703-4c17-b6eb-f5a1577d7735" returned: 0 in 0.514s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Lock "cinder-quobyte-633c8a34-3703-4c17-b6eb-f5a1577d7735" released by "delete_volume" :: held 1.159s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Created reservations ['31b72679-683a-41b2-b042-3bfa4b1c7f1e', 'c5335186-4995-4691-95fe-c6676d710d77', '6c45509c-d9f2-49dc-a880-720fc419651c', '23929f6d-6e0b-4b5f-86b3-1f1156fe5e37'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:35 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:41:35 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:35 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Flow 'volume_create_manager' (6ee4d5ce-a0ec-48dc-a824-097c2f1c59f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be78ca0e-9712-42a2-a463-7ac4f28cb9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.663s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 8 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be78ca0e-9712-42a2-a463-7ac4f28cb9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-946794168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3820ed-81b0-44c1-86a3-cb13b9a22aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422c1676ccb44a5899345181dfd27b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:35Z,use_quota=True,user_id='487bb253f80f4ad18a9fcd1bfc402028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36859552-823a-4c21-93e2-166a1397d1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36859552-823a-4c21-93e2-166a1397d1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c641a483-469d-43d6-8600-3d7b2165afb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c641a483-469d-43d6-8600-3d7b2165afb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e3820ed-81b0-44c1-86a3-cb13b9a22aea', 'volume_name': 'volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a01a6f8-491f-4d8a-8ff8-b6e24b64eb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a01a6f8-491f-4d8a-8ff8-b6e24b64eb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98bfe829-a4c9-4c32-9b1a-39bb0df8fab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:35 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Volume 7e3820ed-81b0-44c1-86a3-cb13b9a22aea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea', 'volume_size': 1} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-946794168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3820ed-81b0-44c1-86a3-cb13b9a22aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422c1676ccb44a5899345181dfd27b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:35Z,use_quota=True,user_id='487bb253f80f4ad18a9fcd1bfc402028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Creating volume 7e3820ed-81b0-44c1-86a3-cb13b9a22aea {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:41:35 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:35 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea 1073741824 Jul 19 17:41:35 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:35 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.437s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:41:35 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Deleted volume successfully. Jul 19 17:41:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac119700-c319-424e-9207-b465c549a423 tempest-AttachVolumeTestJSON-374548148 None] Lock "cinder-633c8a34-3703-4c17-b6eb-f5a1577d7735-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "cinder-45418f6b-e24a-466f-8d18-315bd088282f-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Lock "cinder-45418f6b-e24a-466f-8d18-315bd088282f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "cinder-quobyte-45418f6b-e24a-466f-8d18-315bd088282f" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Lock "cinder-quobyte-45418f6b-e24a-466f-8d18-315bd088282f" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:36 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea 1073741824" returned: 0 in 0.653s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7480034e-d35c-4020-9ba6-5e59ddbb604d]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-45418f6b-e24a-466f-8d18-315bd088282f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:36 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea Jul 19 17:41:36 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:36 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-45418f6b-e24a-466f-8d18-315bd088282f Jul 19 17:41:36 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:36 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" returned: 0 in 0.366s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98bfe829-a4c9-4c32-9b1a-39bb0df8fab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4956872-f290-4585-b7b4-8651f07d5d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:36 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Volume volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea (7e3820ed-81b0-44c1-86a3-cb13b9a22aea): created successfully Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4956872-f290-4585-b7b4-8651f07d5d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Flow 'volume_create_manager' (6ee4d5ce-a0ec-48dc-a824-097c2f1c59f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:36 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-45418f6b-e24a-466f-8d18-315bd088282f" returned: 0 in 0.494s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-45418f6b-e24a-466f-8d18-315bd088282f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:36 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-cb72ac52-30bb-4c67-b98f-ae9eb7e28a11 tempest-SnapshotsActionsTest-1264436496 None] Created volume successfully. Jul 19 17:41:36 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-45418f6b-e24a-466f-8d18-315bd088282f Jul 19 17:41:36 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:37 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-45418f6b-e24a-466f-8d18-315bd088282f" returned: 0 in 0.308s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Lock "cinder-quobyte-45418f6b-e24a-466f-8d18-315bd088282f" released by "delete_volume" :: held 0.854s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Created reservations ['58fc7c0f-ccae-4d32-95e9-cb40b4c72d7a', 'd60589da-c730-465a-994d-3e3876ea97c1', '50dba5f3-a5ab-424c-84f6-2521e1dfd020', '30a0d210-eeaa-4beb-99cc-cc157e75dd1b'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:37 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:41:37 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "cinder-c36c9641-a01e-4e32-a01b-8fe8450e7ca2-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Lock "cinder-c36c9641-a01e-4e32-a01b-8fe8450e7ca2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:37 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.358s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:41:37 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Deleted volume successfully. Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b65b1191-daa8-4a6c-b407-6137f5ec670a tempest-AttachVolumeTestJSON-374548148 None] Lock "cinder-45418f6b-e24a-466f-8d18-315bd088282f-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "cinder-quobyte-c36c9641-a01e-4e32-a01b-8fe8450e7ca2" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Lock "cinder-quobyte-c36c9641-a01e-4e32-a01b-8fe8450e7ca2" acquired by "delete_volume" :: waited 0.029s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[678270ce-dada-4282-8737-5f0f3c206d66]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:37 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2 Jul 19 17:41:37 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] Creating offline snapshot 80083a9a-bcd6-45be-b1b6-6e12f4179a3f of volume 7e3820ed-81b0-44c1-86a3-cb13b9a22aea {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffe5d99-24d4-4c0e-97e1-057f2f141e55]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:41:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:38 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea Jul 19 17:41:38 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2" returned: 0 in 0.507s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:38 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:38 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2 Jul 19 17:41:38 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:38 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" returned: 0 in 0.767s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:38 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f 1G Jul 19 17:41:38 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:38 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c36c9641-a01e-4e32-a01b-8fe8450e7ca2" returned: 0 in 0.593s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Lock "cinder-quobyte-c36c9641-a01e-4e32-a01b-8fe8450e7ca2" released by "delete_volume" :: held 1.184s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:39 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Created reservations ['eafb0c47-dcb0-40f5-a730-18843d06e152', '16f74c25-8ff6-4b4e-81c5-5416cc1d136f', 'df5fe9f4-d0f4-4cb5-bdec-3c3838921be6', '11787194-0e5d-4d76-8204-3187e10b3d8b'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:41:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:41:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:41:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:39 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:41:39 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:39 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f 1G" returned: 0 in 1.039s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:39 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f Jul 19 17:41:39 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:39 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.623s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:39 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:41:39 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Deleted volume successfully. Jul 19 17:41:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a8d4eda2-109f-4a3f-b096-2a2e1871e959 tempest-AttachVolumeTestJSON-374548148 None] Lock "cinder-c36c9641-a01e-4e32-a01b-8fe8450e7ca2-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:40 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f" returned: 0 in 0.603s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:40 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f is being set with open permissions: ugo+rw Jul 19 17:41:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:40 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f Jul 19 17:41:40 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:40 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f" returned: 0 in 0.403s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:40 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.info Jul 19 17:41:40 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:41 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.info" returned: 0 in 0.476s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:41 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.info is being set with open permissions: ugo+rw Jul 19 17:41:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:41 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.info Jul 19 17:41:41 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:41 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.info" returned: 0 in 0.500s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.941s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:41 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-341b6e16-ae9a-4b03-82ef-1f1ce915cee8 tempest-SnapshotsActionsTest-1264436496 None] Create snapshot completed successfully Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Flow 'volume_create_manager' (c2adeac2-1d4d-44b0-8570-a5b936ca2b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3578a04-edc0-4a2a-b9d1-e212d4c2560d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e2f7517b-4d6c-4323-b711-73f886816c94 tempest-SnapshotsActionsTest-1264436496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e2f7517b-4d6c-4323-b711-73f886816c94 tempest-SnapshotsActionsTest-1264436496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3578a04-edc0-4a2a-b9d1-e212d4c2560d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1409436729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b305b59-c373-4a71-9b0e-d9c64fd3ad0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fc996e5d954c3f84d822a1e46af847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:44Z,use_quota=True,user_id='aa3f1429244a436c8afcbb47ff3fc3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0dc20fd-9a53-4018-af0b-1caa1d0a4df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0dc20fd-9a53-4018-af0b-1caa1d0a4df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7b2f70-f9f1-4f52-942a-f7aef8da7143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7b2f70-f9f1-4f52-942a-f7aef8da7143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b305b59-c373-4a71-9b0e-d9c64fd3ad0d', 'volume_name': 'volume-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebc410a-fc9f-460d-8ba0-d5291b37ab84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebc410a-fc9f-460d-8ba0-d5291b37ab84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266514de-4de3-4554-aca9-04a520ae201e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:43 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Volume 2b305b59-c373-4a71-9b0e-d9c64fd3ad0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d', 'volume_size': 1} Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-e2f7517b-4d6c-4323-b711-73f886816c94 tempest-SnapshotsActionsTest-1264436496 None] Creating offline snapshot bc24d119-8739-4a96-a8bf-9d4a6bdcad12 of volume 7e3820ed-81b0-44c1-86a3-cb13b9a22aea {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d36f3a3-6a6f-4b64-a106-8a51f5139ba8]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:41:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e2f7517b-4d6c-4323-b711-73f886816c94 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:44 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f Jul 19 17:41:44 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:44 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e2f7517b-4d6c-4323-b711-73f886816c94 tempest-SnapshotsActionsTest-1264436496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f" returned: 0 in 0.519s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-e2f7517b-4d6c-4323-b711-73f886816c94 tempest-SnapshotsActionsTest-1264436496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:41:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e2f7517b-4d6c-4323-b711-73f886816c94 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:44 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12 1G Jul 19 17:41:44 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:45 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e2f7517b-4d6c-4323-b711-73f886816c94 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12 1G" returned: 0 in 0.681s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e2f7517b-4d6c-4323-b711-73f886816c94 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:45 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12 Jul 19 17:41:45 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:45 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e2f7517b-4d6c-4323-b711-73f886816c94 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12" returned: 0 in 0.501s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:45 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-e2f7517b-4d6c-4323-b711-73f886816c94 tempest-SnapshotsActionsTest-1264436496 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12 is being set with open permissions: ugo+rw Jul 19 17:41:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e2f7517b-4d6c-4323-b711-73f886816c94 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:45 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12 Jul 19 17:41:45 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:45 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e2f7517b-4d6c-4323-b711-73f886816c94 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12" returned: 0 in 0.356s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e2f7517b-4d6c-4323-b711-73f886816c94 tempest-SnapshotsActionsTest-1264436496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.292s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.219s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1409436729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b305b59-c373-4a71-9b0e-d9c64fd3ad0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fc996e5d954c3f84d822a1e46af847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:44Z,use_quota=True,user_id='aa3f1429244a436c8afcbb47ff3fc3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:41:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Creating volume 2b305b59-c373-4a71-9b0e-d9c64fd3ad0d {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:41:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:41:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:41:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:41:46 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:41:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:46 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d 1073741824 Jul 19 17:41:46 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:46 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-e2f7517b-4d6c-4323-b711-73f886816c94 tempest-SnapshotsActionsTest-1264436496 None] Create snapshot completed successfully Jul 19 17:41:46 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d 1073741824" returned: 0 in 0.660s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:46 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d Jul 19 17:41:46 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Acquiring lock "cinder-bc24d119-8739-4a96-a8bf-9d4a6bdcad12-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-bc24d119-8739-4a96-a8bf-9d4a6bdcad12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Acquiring lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Acquiring lock "cinder-quobyte-bc24d119-8739-4a96-a8bf-9d4a6bdcad12" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-quobyte-bc24d119-8739-4a96-a8bf-9d4a6bdcad12" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Deleting offline snapshot bc24d119-8739-4a96-a8bf-9d4a6bdcad12 of volume 7e3820ed-81b0-44c1-86a3-cb13b9a22aea {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] snapshot_file for this snap is: volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8694b82d-3d46-460b-a385-2fe18100d6e4]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:47 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d" returned: 0 in 0.467s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:47 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12 Jul 19 17:41:47 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266514de-4de3-4554-aca9-04a520ae201e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcef5be-2dbd-4733-934d-6c1285a2f2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:47 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Volume volume-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d (2b305b59-c373-4a71-9b0e-d9c64fd3ad0d): created successfully Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcef5be-2dbd-4733-934d-6c1285a2f2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Flow 'volume_create_manager' (c2adeac2-1d4d-44b0-8570-a5b936ca2b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:47 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8423e301-fd7c-481a-835c-132b2edf020a tempest-VolumesActionsTest-252368892 None] Created volume successfully. Jul 19 17:41:47 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12" returned: 0 in 0.633s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d95f122-8b6c-4615-872f-d18b2c36faa1]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a4078a20-b7c3-4094-bc8d-1615f08eb2b7 tempest-VolumesActionsTest-252368892 None] Acquiring lock "cinder-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d" by "attach_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a4078a20-b7c3-4094-bc8d-1615f08eb2b7 tempest-VolumesActionsTest-252368892 None] Lock "cinder-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d" acquired by "attach_volume" :: waited 0.046s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:48 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f Jul 19 17:41:48 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:48 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a4078a20-b7c3-4094-bc8d-1615f08eb2b7 tempest-VolumesActionsTest-252368892 None] Attaching volume 2b305b59-c373-4a71-9b0e-d9c64fd3ad0d to instance 8f5a9524-7964-444b-b210-e352b82d7dbc at mountpoint /dev/vdb on host None. Jul 19 17:41:48 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a4078a20-b7c3-4094-bc8d-1615f08eb2b7 tempest-VolumesActionsTest-252368892 None] Attach volume completed successfully. Jul 19 17:41:48 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a4078a20-b7c3-4094-bc8d-1615f08eb2b7 tempest-VolumesActionsTest-252368892 None] Lock "cinder-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d" released by "attach_volume" :: held 0.205s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:48 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f" returned: 0 in 0.683s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:41:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:48 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12 Jul 19 17:41:48 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:49 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12" returned: 0 in 0.547s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:49 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12 Jul 19 17:41:49 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:49 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-d808625e-b6d0-4844-a2a1-1e7548dbe4d7 tempest-VolumesActionsTest-1797907957 None] Terminate volume connection completed successfully. Jul 19 17:41:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d808625e-b6d0-4844-a2a1-1e7548dbe4d7 tempest-VolumesActionsTest-1797907957 None] Acquiring lock "cinder-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d-detach_volume" by "detach_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:49 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.bc24d119-8739-4a96-a8bf-9d4a6bdcad12" returned: 0 in 0.420s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d808625e-b6d0-4844-a2a1-1e7548dbe4d7 tempest-VolumesActionsTest-1797907957 None] Lock "cinder-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d-detach_volume" acquired by "detach_volume" :: waited 0.057s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-quobyte-bc24d119-8739-4a96-a8bf-9d4a6bdcad12" released by "_delete_snapshot" :: held 2.449s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" released by "delete_snapshot" :: held 2.494s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:49 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-d808625e-b6d0-4844-a2a1-1e7548dbe4d7 tempest-VolumesActionsTest-1797907957 None] Detaching volume 2b305b59-c373-4a71-9b0e-d9c64fd3ad0d from instance 8f5a9524-7964-444b-b210-e352b82d7dbc. Jul 19 17:41:49 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Created reservations ['e8775c6f-0a50-4e34-b25c-28eb68b90181', '6bc3e109-0db5-407a-b673-e7561359998a', '6d984870-cb26-4a8c-9b39-54318f9a0921', '13548c58-6c90-49d2-8381-511b761b949b'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:41:49 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-d808625e-b6d0-4844-a2a1-1e7548dbe4d7 tempest-VolumesActionsTest-1797907957 None] Detach volume completed successfully. Jul 19 17:41:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d808625e-b6d0-4844-a2a1-1e7548dbe4d7 tempest-VolumesActionsTest-1797907957 None] Lock "cinder-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d-detach_volume" released by "detach_volume" :: held 0.178s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:49 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Delete snapshot completed successfully. Jul 19 17:41:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c1d2c93f-ce28-49cd-bbe3-e5d00b72b441 tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-bc24d119-8739-4a96-a8bf-9d4a6bdcad12-delete_snapshot" released by "delete_snapshot" :: held 2.723s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-53f65877-ff53-4602-9b3f-e67375460793 tempest-VolumesActionsTest-252368892 None] Acquiring lock "cinder-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d-detach_volume" by "detach_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-53f65877-ff53-4602-9b3f-e67375460793 tempest-VolumesActionsTest-252368892 None] Lock "cinder-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:49 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-53f65877-ff53-4602-9b3f-e67375460793 tempest-VolumesActionsTest-252368892 None] Volume detach called, but volume not attached. Jul 19 17:41:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-53f65877-ff53-4602-9b3f-e67375460793 tempest-VolumesActionsTest-252368892 None] Lock "cinder-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Acquiring lock "cinder-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Lock "cinder-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Acquiring lock "cinder-quobyte-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Lock "cinder-quobyte-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d" acquired by "delete_volume" :: waited 0.045s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:50 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7e15b2-3025-4339-95b6-dcabdfe61152]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:41:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:50 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d Jul 19 17:41:50 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-23e93c6c-c7f0-4a80-a8f3-dec7837bf4c1 tempest-SnapshotsActionsTest-1264436496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-23e93c6c-c7f0-4a80-a8f3-dec7837bf4c1 tempest-SnapshotsActionsTest-1264436496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-23e93c6c-c7f0-4a80-a8f3-dec7837bf4c1 tempest-SnapshotsActionsTest-1264436496 None] Creating offline snapshot 113582ce-92fc-4814-bc94-af503372358f of volume 7e3820ed-81b0-44c1-86a3-cb13b9a22aea {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:41:51 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2a9d16-2cc9-45d8-b9fe-edf96014a778]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:41:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23e93c6c-c7f0-4a80-a8f3-dec7837bf4c1 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:51 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d" returned: 0 in 0.716s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:51 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f Jul 19 17:41:51 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:51 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d Jul 19 17:41:51 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:51 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23e93c6c-c7f0-4a80-a8f3-dec7837bf4c1 tempest-SnapshotsActionsTest-1264436496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f" returned: 0 in 0.633s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-23e93c6c-c7f0-4a80-a8f3-dec7837bf4c1 tempest-SnapshotsActionsTest-1264436496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:41:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23e93c6c-c7f0-4a80-a8f3-dec7837bf4c1 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:51 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d" returned: 0 in 0.487s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:51 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f 1G Jul 19 17:41:51 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:51 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Lock "cinder-quobyte-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d" released by "delete_volume" :: held 1.300s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:51 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Created reservations ['3f0af570-2cef-47d6-b79d-9cb384b88160', '3873eaca-e60c-4dac-8f00-ba2aa1a835ba', '40ecd3f6-0594-45f2-aca0-fd52b4bd2e4a', 'f89c0bc7-f587-4cad-ae4f-8ce70686093a'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:52 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:41:52 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:41:52 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Flow 'volume_create_manager' (6e301c13-3fb8-426b-a307-cad555f6b043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:52 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9903ab-cbaf-4653-9653-9eb1465fedd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.500s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23e93c6c-c7f0-4a80-a8f3-dec7837bf4c1 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f 1G" returned: 0 in 0.841s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23e93c6c-c7f0-4a80-a8f3-dec7837bf4c1 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:52 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Deleted volume successfully. Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9903ab-cbaf-4653-9653-9eb1465fedd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1763900654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1e006e-b972-46f5-b5ae-6dc05094491d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b620d26f26864b0fa10b3e847b1ababd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:52Z,use_quota=True,user_id='e747ceaebbe3444fb4f460302fcb35ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b06af12-276e-42c8-b482-c7af020f917e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b06af12-276e-42c8-b482-c7af020f917e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2914129f-a59e-4ec4-a6fd-a6e04793c903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2914129f-a59e-4ec4-a6fd-a6e04793c903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb1e006e-b972-46f5-b5ae-6dc05094491d', 'volume_name': 'volume-cb1e006e-b972-46f5-b5ae-6dc05094491d', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:52 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f Jul 19 17:41:52 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf53642-52c1-4865-ad47-d51d73fd7274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf53642-52c1-4865-ad47-d51d73fd7274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cbe7288-8854-496f-959e-d57eb67de560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:52 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Volume cb1e006e-b972-46f5-b5ae-6dc05094491d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb1e006e-b972-46f5-b5ae-6dc05094491d', 'volume_size': 1} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-854c13a3-85fb-47eb-a8fa-260cb4a2c022 tempest-VolumesActionsTest-252368892 None] Lock "cinder-2b305b59-c373-4a71-9b0e-d9c64fd3ad0d-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:53 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23e93c6c-c7f0-4a80-a8f3-dec7837bf4c1 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f" returned: 0 in 0.554s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:53 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-23e93c6c-c7f0-4a80-a8f3-dec7837bf4c1 tempest-SnapshotsActionsTest-1264436496 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f is being set with open permissions: ugo+rw Jul 19 17:41:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23e93c6c-c7f0-4a80-a8f3-dec7837bf4c1 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:53 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f Jul 19 17:41:53 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:53 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23e93c6c-c7f0-4a80-a8f3-dec7837bf4c1 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f" returned: 0 in 0.428s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-23e93c6c-c7f0-4a80-a8f3-dec7837bf4c1 tempest-SnapshotsActionsTest-1264436496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.649s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.918s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1763900654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1e006e-b972-46f5-b5ae-6dc05094491d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b620d26f26864b0fa10b3e847b1ababd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:52Z,use_quota=True,user_id='e747ceaebbe3444fb4f460302fcb35ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:41:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Creating volume cb1e006e-b972-46f5-b5ae-6dc05094491d {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:41:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:41:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:41:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:41:53 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:41:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb1e006e-b972-46f5-b5ae-6dc05094491d 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:53 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb1e006e-b972-46f5-b5ae-6dc05094491d 1073741824 Jul 19 17:41:53 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:53 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-23e93c6c-c7f0-4a80-a8f3-dec7837bf4c1 tempest-SnapshotsActionsTest-1264436496 None] Create snapshot completed successfully Jul 19 17:41:54 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Acquiring lock "cinder-113582ce-92fc-4814-bc94-af503372358f-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb1e006e-b972-46f5-b5ae-6dc05094491d 1073741824" returned: 0 in 0.638s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-113582ce-92fc-4814-bc94-af503372358f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Acquiring lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Acquiring lock "cinder-quobyte-113582ce-92fc-4814-bc94-af503372358f" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb1e006e-b972-46f5-b5ae-6dc05094491d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-quobyte-113582ce-92fc-4814-bc94-af503372358f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Deleting offline snapshot 113582ce-92fc-4814-bc94-af503372358f of volume 7e3820ed-81b0-44c1-86a3-cb13b9a22aea {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:41:54 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb1e006e-b972-46f5-b5ae-6dc05094491d Jul 19 17:41:54 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] snapshot_file for this snap is: volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0debe888-6ccb-46f0-a901-5c9fd1d85acb]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:54 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f Jul 19 17:41:54 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:54 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb1e006e-b972-46f5-b5ae-6dc05094491d" returned: 0 in 0.510s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cbe7288-8854-496f-959e-d57eb67de560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb1e006e-b972-46f5-b5ae-6dc05094491d', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9660e52e-a74c-40f5-a4e3-ae9a52c3928f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:54 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Volume volume-cb1e006e-b972-46f5-b5ae-6dc05094491d (cb1e006e-b972-46f5-b5ae-6dc05094491d): created successfully Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9660e52e-a74c-40f5-a4e3-ae9a52c3928f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Flow 'volume_create_manager' (6e301c13-3fb8-426b-a307-cad555f6b043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:54 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-582301bc-7c26-47ef-bf45-5ff946f02f85 tempest-VolumesTestJSON-78238528 None] Created volume successfully. Jul 19 17:41:54 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f" returned: 0 in 0.549s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:41:55 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3dc686-839f-4fa9-9444-73d37799d084]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:41:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:55 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f Jul 19 17:41:55 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:55 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f" returned: 0 in 0.437s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:41:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:55 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f Jul 19 17:41:55 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:55 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f" returned: 0 in 0.431s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:55 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f Jul 19 17:41:55 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:56 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.113582ce-92fc-4814-bc94-af503372358f" returned: 0 in 0.488s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-quobyte-113582ce-92fc-4814-bc94-af503372358f" released by "_delete_snapshot" :: held 2.080s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" released by "delete_snapshot" :: held 2.128s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Flow 'volume_create_manager' (8e056417-9873-4027-a0b1-666716804d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992b011b-31df-4db3-8e5a-92304e2ea7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992b011b-31df-4db3-8e5a-92304e2ea7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1334048892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9418b9-703c-401e-a4bc-784113b64961,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b620d26f26864b0fa10b3e847b1ababd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:56Z,use_quota=True,user_id='e747ceaebbe3444fb4f460302fcb35ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac806a95-0468-4e8b-b667-b2b93051be08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac806a95-0468-4e8b-b667-b2b93051be08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9330d2-e0ce-438e-b8fb-68c4e9dcc514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9330d2-e0ce-438e-b8fb-68c4e9dcc514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e9418b9-703c-401e-a4bc-784113b64961', 'volume_name': 'volume-0e9418b9-703c-401e-a4bc-784113b64961', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8693661-ed5b-4b35-8284-d0bbf47fb134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8693661-ed5b-4b35-8284-d0bbf47fb134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99611dc3-3562-424d-aab0-c8bb68b6b960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:56 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Volume 0e9418b9-703c-401e-a4bc-784113b64961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e9418b9-703c-401e-a4bc-784113b64961', 'volume_size': 1} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1334048892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9418b9-703c-401e-a4bc-784113b64961,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b620d26f26864b0fa10b3e847b1ababd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:56Z,use_quota=True,user_id='e747ceaebbe3444fb4f460302fcb35ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Creating volume 0e9418b9-703c-401e-a4bc-784113b64961 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:41:56 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0e9418b9-703c-401e-a4bc-784113b64961 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:56 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0e9418b9-703c-401e-a4bc-784113b64961 1073741824 Jul 19 17:41:56 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Flow 'volume_create_manager' (d71f3b40-f409-4f9b-a533-45ce880b3e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a808f72-5f86-4e25-a96a-b5319bbc2034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a808f72-5f86-4e25-a96a-b5319bbc2034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-320877526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d132095-7761-4de8-8dfa-86ed4ea9de14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fc996e5d954c3f84d822a1e46af847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:57Z,use_quota=True,user_id='aa3f1429244a436c8afcbb47ff3fc3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd4847e-e5a0-484b-a17a-6ff94446e9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd4847e-e5a0-484b-a17a-6ff94446e9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8d9751-d52f-43be-b3a3-f9bb140db94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8d9751-d52f-43be-b3a3-f9bb140db94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d132095-7761-4de8-8dfa-86ed4ea9de14', 'volume_name': 'volume-5d132095-7761-4de8-8dfa-86ed4ea9de14', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de81622-0b32-4078-86f4-4f40c51ca7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de81622-0b32-4078-86f4-4f40c51ca7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7bdaa2-45ae-4e13-b0a5-d92ec7b73d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:56 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Volume 5d132095-7761-4de8-8dfa-86ed4ea9de14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d132095-7761-4de8-8dfa-86ed4ea9de14', 'volume_size': 1} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Created reservations ['1a614467-d69b-4d81-aa3d-a7c694794c75', '81ed9a88-0827-4230-818b-575bf8b31ec0', 'ac50aad9-ab5a-4a3d-812b-7235e20660cf', 'c8f488c3-8845-4a6a-9094-4207af908880'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:41:56 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Delete snapshot completed successfully. Jul 19 17:41:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ccb51601-dfd0-4dd7-81ad-c08110678c61 tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-113582ce-92fc-4814-bc94-af503372358f-delete_snapshot" released by "delete_snapshot" :: held 2.516s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:57 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0e9418b9-703c-401e-a4bc-784113b64961 1073741824" returned: 0 in 0.471s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0e9418b9-703c-401e-a4bc-784113b64961 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:57 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0e9418b9-703c-401e-a4bc-784113b64961 Jul 19 17:41:57 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:57 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0e9418b9-703c-401e-a4bc-784113b64961" returned: 0 in 0.243s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.629s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-320877526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d132095-7761-4de8-8dfa-86ed4ea9de14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fc996e5d954c3f84d822a1e46af847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:57Z,use_quota=True,user_id='aa3f1429244a436c8afcbb47ff3fc3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Creating volume 5d132095-7761-4de8-8dfa-86ed4ea9de14 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:41:57 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d132095-7761-4de8-8dfa-86ed4ea9de14 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99611dc3-3562-424d-aab0-c8bb68b6b960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e9418b9-703c-401e-a4bc-784113b64961', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:57 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d132095-7761-4de8-8dfa-86ed4ea9de14 1073741824 Jul 19 17:41:57 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35006309-f39f-4cbd-b8e8-798be31c83eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:57 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Volume volume-0e9418b9-703c-401e-a4bc-784113b64961 (0e9418b9-703c-401e-a4bc-784113b64961): created successfully Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35006309-f39f-4cbd-b8e8-798be31c83eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Flow 'volume_create_manager' (8e056417-9873-4027-a0b1-666716804d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:57 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-1cda1427-3198-4f4a-8ccf-9b8eaff98264 tempest-VolumesTestJSON-78238528 None] Created volume successfully. Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8abf4851-3935-4570-addb-0afdb77263dd tempest-SnapshotsActionsTest-1264436496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:57 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d132095-7761-4de8-8dfa-86ed4ea9de14 1073741824" returned: 0 in 0.543s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d132095-7761-4de8-8dfa-86ed4ea9de14 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:57 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d132095-7761-4de8-8dfa-86ed4ea9de14 Jul 19 17:41:57 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:58 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d132095-7761-4de8-8dfa-86ed4ea9de14" returned: 0 in 0.256s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:41:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8abf4851-3935-4570-addb-0afdb77263dd tempest-SnapshotsActionsTest-1264436496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.337s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7bdaa2-45ae-4e13-b0a5-d92ec7b73d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d132095-7761-4de8-8dfa-86ed4ea9de14', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8712990-0f9f-41eb-95ca-f48e0cb5ee26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-8abf4851-3935-4570-addb-0afdb77263dd tempest-SnapshotsActionsTest-1264436496 None] Creating offline snapshot 2e5dae78-41e4-496b-a469-e98605212e00 of volume 7e3820ed-81b0-44c1-86a3-cb13b9a22aea {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:41:58 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Volume volume-5d132095-7761-4de8-8dfa-86ed4ea9de14 (5d132095-7761-4de8-8dfa-86ed4ea9de14): created successfully Jul 19 17:41:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8712990-0f9f-41eb-95ca-f48e0cb5ee26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Flow 'volume_create_manager' (d71f3b40-f409-4f9b-a533-45ce880b3e62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:58 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4909482-e011-406a-96e4-774636a38cbf]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:41:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8abf4851-3935-4570-addb-0afdb77263dd tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:58 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b5301241-9936-46a5-9152-07dfa208753b tempest-VolumesActionsTest-252368892 None] Created volume successfully. Jul 19 17:41:58 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f Jul 19 17:41:58 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:58 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8abf4851-3935-4570-addb-0afdb77263dd tempest-SnapshotsActionsTest-1264436496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f" returned: 0 in 0.426s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-8abf4851-3935-4570-addb-0afdb77263dd tempest-SnapshotsActionsTest-1264436496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:41:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8abf4851-3935-4570-addb-0afdb77263dd tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:58 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00 1G Jul 19 17:41:58 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Acquiring lock "cinder-5d132095-7761-4de8-8dfa-86ed4ea9de14-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Lock "cinder-5d132095-7761-4de8-8dfa-86ed4ea9de14-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Acquiring lock "cinder-quobyte-5d132095-7761-4de8-8dfa-86ed4ea9de14" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Lock "cinder-quobyte-5d132095-7761-4de8-8dfa-86ed4ea9de14" acquired by "delete_volume" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Flow 'volume_create_manager' (080a217e-8816-4946-86c3-818ffc3b0430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38b009e-1196-436f-9a7b-3e3610265618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e463af-b7fb-47f9-921d-35a0db88ac61]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:41:59 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d132095-7761-4de8-8dfa-86ed4ea9de14 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8abf4851-3935-4570-addb-0afdb77263dd tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00 1G" returned: 0 in 0.577s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8abf4851-3935-4570-addb-0afdb77263dd tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:59 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00 Jul 19 17:41:59 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38b009e-1196-436f-9a7b-3e3610265618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1015349322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='766379ba6f1743298f0266f13e4b2423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:59Z,use_quota=True,user_id='e2c61ab293e64e248e12a83da1433c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2aeb82d-aaa3-47d4-b9be-e161cb1eace4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2aeb82d-aaa3-47d4-b9be-e161cb1eace4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78eb535-1781-4959-be46-b834dfe40937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78eb535-1781-4959-be46-b834dfe40937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe', 'volume_name': 'volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3baaa5d-9e4c-41fe-88d2-c6d0dc0840d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3baaa5d-9e4c-41fe-88d2-c6d0dc0840d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec55abc-301f-4315-9561-bbbaad4d8fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:59 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Volume 7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe', 'volume_size': 1} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:41:59 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d132095-7761-4de8-8dfa-86ed4ea9de14 Jul 19 17:41:59 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Flow 'volume_create_manager' (d87caabf-1d97-4785-acad-c1ef1a68cfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7091b1cc-3710-4fd9-9040-d79b067d8bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7091b1cc-3710-4fd9-9040-d79b067d8bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1548683664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746e1e98-b6bf-4d0b-8652-d5fb908dc54a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b620d26f26864b0fa10b3e847b1ababd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:59Z,use_quota=True,user_id='e747ceaebbe3444fb4f460302fcb35ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdaa0eb-7546-40b9-b016-6c92ef9b91a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdaa0eb-7546-40b9-b016-6c92ef9b91a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5e1a1c-0075-42b1-86e9-cc7a2cace61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5e1a1c-0075-42b1-86e9-cc7a2cace61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '746e1e98-b6bf-4d0b-8652-d5fb908dc54a', 'volume_name': 'volume-746e1e98-b6bf-4d0b-8652-d5fb908dc54a', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094f4ae0-9f6a-438f-9237-1c9930d0f770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094f4ae0-9f6a-438f-9237-1c9930d0f770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536d7aa0-bcb2-460b-b0d5-7184cabf64c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:41:59 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Volume 746e1e98-b6bf-4d0b-8652-d5fb908dc54a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-746e1e98-b6bf-4d0b-8652-d5fb908dc54a', 'volume_size': 1} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:59 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8abf4851-3935-4570-addb-0afdb77263dd tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00" returned: 0 in 0.301s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:59 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-8abf4851-3935-4570-addb-0afdb77263dd tempest-SnapshotsActionsTest-1264436496 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00 is being set with open permissions: ugo+rw Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8abf4851-3935-4570-addb-0afdb77263dd tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:59 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00 Jul 19 17:41:59 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:59 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d132095-7761-4de8-8dfa-86ed4ea9de14" returned: 0 in 0.380s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d132095-7761-4de8-8dfa-86ed4ea9de14 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:59 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d132095-7761-4de8-8dfa-86ed4ea9de14 Jul 19 17:41:59 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:59 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8abf4851-3935-4570-addb-0afdb77263dd tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00" returned: 0 in 0.249s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8abf4851-3935-4570-addb-0afdb77263dd tempest-SnapshotsActionsTest-1264436496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.676s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.513s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1015349322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='766379ba6f1743298f0266f13e4b2423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:59Z,use_quota=True,user_id='e2c61ab293e64e248e12a83da1433c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Creating volume 7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:41:59 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:41:59 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Jul 19 17:41:59 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe 1073741824 Jul 19 17:41:59 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d132095-7761-4de8-8dfa-86ed4ea9de14" returned: 0 in 0.263s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Lock "cinder-quobyte-5d132095-7761-4de8-8dfa-86ed4ea9de14" released by "delete_volume" :: held 0.771s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:41:59 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8abf4851-3935-4570-addb-0afdb77263dd tempest-SnapshotsActionsTest-1264436496 None] Create snapshot completed successfully Jul 19 17:41:59 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Created reservations ['be37ba85-7a01-4f57-8ac6-e604d12c9257', '1c33f8cf-d434-45c9-b2ce-6e28fc22cf0d', 'e7a28ff7-8d10-403a-8ba9-ccf3c7e6a742', 'd019e349-ddef-4fc1-baec-73fd60d1012f'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:00 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:00 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:00 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.272s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:00 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Deleted volume successfully. Jul 19 17:42:00 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe 1073741824" returned: 0 in 0.485s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-932b4905-44a6-43bc-805c-f84a2f0576e5 tempest-VolumesActionsTest-1797907957 None] Lock "cinder-5d132095-7761-4de8-8dfa-86ed4ea9de14-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:00 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe Jul 19 17:42:00 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:00 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe" returned: 0 in 0.242s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.199s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1548683664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746e1e98-b6bf-4d0b-8652-d5fb908dc54a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b620d26f26864b0fa10b3e847b1ababd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:41:59Z,use_quota=True,user_id='e747ceaebbe3444fb4f460302fcb35ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Creating volume 746e1e98-b6bf-4d0b-8652-d5fb908dc54a {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:00 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-746e1e98-b6bf-4d0b-8652-d5fb908dc54a 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:00 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-746e1e98-b6bf-4d0b-8652-d5fb908dc54a 1073741824 Jul 19 17:42:00 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec55abc-301f-4315-9561-bbbaad4d8fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd735a39-9f66-41d8-baf4-bc20fef61b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:00 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Volume volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe (7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe): created successfully Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd735a39-9f66-41d8-baf4-bc20fef61b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Flow 'volume_create_manager' (080a217e-8816-4946-86c3-818ffc3b0430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:00 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-df45e8ce-470a-4182-998d-e30e3d834880 tempest-VolumesDeleteCascade-1585903139 None] Created volume successfully. Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Flow 'volume_create_manager' (e965746d-bc1e-49d3-99b7-27f1b0ec6d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac98b36-72e7-4b47-8a8f-a323559a5ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac98b36-72e7-4b47-8a8f-a323559a5ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1341579355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8661f4b-2b4f-40b3-90c8-82803602469f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fc996e5d954c3f84d822a1e46af847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:01Z,use_quota=True,user_id='aa3f1429244a436c8afcbb47ff3fc3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e790152a-9b12-4c91-a855-2a66f41f75ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e790152a-9b12-4c91-a855-2a66f41f75ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2900d840-83ed-4838-a7d3-5473f955d0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2900d840-83ed-4838-a7d3-5473f955d0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8661f4b-2b4f-40b3-90c8-82803602469f', 'volume_name': 'volume-d8661f4b-2b4f-40b3-90c8-82803602469f', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fb49f0-771d-4dbb-8e5c-d851737d2872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fb49f0-771d-4dbb-8e5c-d851737d2872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f292e0-1c3b-44b0-8e3d-fc1078a691cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:00 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Volume d8661f4b-2b4f-40b3-90c8-82803602469f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8661f4b-2b4f-40b3-90c8-82803602469f', 'volume_size': 1} Jul 19 17:42:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:01 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-746e1e98-b6bf-4d0b-8652-d5fb908dc54a 1073741824" returned: 0 in 0.450s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-746e1e98-b6bf-4d0b-8652-d5fb908dc54a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Acquiring lock "cinder-2e5dae78-41e4-496b-a469-e98605212e00-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:01 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-746e1e98-b6bf-4d0b-8652-d5fb908dc54a Jul 19 17:42:01 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-2e5dae78-41e4-496b-a469-e98605212e00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Acquiring lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Acquiring lock "cinder-quobyte-2e5dae78-41e4-496b-a469-e98605212e00" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-quobyte-2e5dae78-41e4-496b-a469-e98605212e00" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Deleting offline snapshot 2e5dae78-41e4-496b-a469-e98605212e00 of volume 7e3820ed-81b0-44c1-86a3-cb13b9a22aea {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] snapshot_file for this snap is: volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a384ff07-994b-42c9-aa39-4b55dcc0cdc2]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:01 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00 Jul 19 17:42:01 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:01 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-746e1e98-b6bf-4d0b-8652-d5fb908dc54a" returned: 0 in 0.290s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1341579355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8661f4b-2b4f-40b3-90c8-82803602469f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fc996e5d954c3f84d822a1e46af847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:01Z,use_quota=True,user_id='aa3f1429244a436c8afcbb47ff3fc3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Creating volume d8661f4b-2b4f-40b3-90c8-82803602469f {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:01 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d8661f4b-2b4f-40b3-90c8-82803602469f 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536d7aa0-bcb2-460b-b0d5-7184cabf64c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-746e1e98-b6bf-4d0b-8652-d5fb908dc54a', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:01 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d8661f4b-2b4f-40b3-90c8-82803602469f 1073741824 Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556e3287-91d2-4bd5-8681-a27a1760c9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:01 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:01 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Volume volume-746e1e98-b6bf-4d0b-8652-d5fb908dc54a (746e1e98-b6bf-4d0b-8652-d5fb908dc54a): created successfully Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556e3287-91d2-4bd5-8681-a27a1760c9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Flow 'volume_create_manager' (d87caabf-1d97-4785-acad-c1ef1a68cfd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:01 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-330bf6f1-4173-4657-94e2-a73b8f185b30 tempest-VolumesTestJSON-78238528 None] Created volume successfully. Jul 19 17:42:01 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00" returned: 0 in 0.389s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1a612e-b88c-4073-a500-37a7ebc90254]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:01 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f Jul 19 17:42:01 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:01 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d8661f4b-2b4f-40b3-90c8-82803602469f 1073741824" returned: 0 in 0.459s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d8661f4b-2b4f-40b3-90c8-82803602469f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:01 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d8661f4b-2b4f-40b3-90c8-82803602469f Jul 19 17:42:01 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:02 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f" returned: 0 in 0.358s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:02 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00 Jul 19 17:42:02 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:02 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d8661f4b-2b4f-40b3-90c8-82803602469f" returned: 0 in 0.278s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.902s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f292e0-1c3b-44b0-8e3d-fc1078a691cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8661f4b-2b4f-40b3-90c8-82803602469f', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa644a52-a621-4503-ba8e-cf60de0174e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] Creating offline snapshot dc2dd591-6b80-4f61-af23-d9962b5f1f62 of volume 7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:42:02 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Volume volume-d8661f4b-2b4f-40b3-90c8-82803602469f (d8661f4b-2b4f-40b3-90c8-82803602469f): created successfully Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa644a52-a621-4503-ba8e-cf60de0174e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Flow 'volume_create_manager' (e965746d-bc1e-49d3-99b7-27f1b0ec6d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b1c769-cece-48e3-807a-663d30055439]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:02 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-e7bed6f5-4e11-4bda-957d-b57287b3ced0 tempest-VolumesActionsTest-252368892 None] Created volume successfully. Jul 19 17:42:02 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe Jul 19 17:42:02 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:02 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00" returned: 0 in 0.446s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:02 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00 Jul 19 17:42:02 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:02 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe" returned: 0 in 0.420s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:02 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 1G Jul 19 17:42:02 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:02 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.2e5dae78-41e4-496b-a469-e98605212e00" returned: 0 in 0.322s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-quobyte-2e5dae78-41e4-496b-a469-e98605212e00" released by "_delete_snapshot" :: held 1.633s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" released by "delete_snapshot" :: held 1.664s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:02 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Created reservations ['ee0f5363-f17f-49e2-bfd5-c5499658c63e', '695f2ca0-ecb6-4588-8f4b-de02f45617e3', '14673091-99df-400f-935f-a268b45723cd', '2082d4b6-0cb7-4963-beb7-6b5e4e72bed7'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Acquiring lock "cinder-d8661f4b-2b4f-40b3-90c8-82803602469f-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:03 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Delete snapshot completed successfully. Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Lock "cinder-d8661f4b-2b4f-40b3-90c8-82803602469f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0540b8ef-5d9a-488e-9442-afeb1cd8ea4b tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-2e5dae78-41e4-496b-a469-e98605212e00-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Acquiring lock "cinder-quobyte-d8661f4b-2b4f-40b3-90c8-82803602469f" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Lock "cinder-quobyte-d8661f4b-2b4f-40b3-90c8-82803602469f" acquired by "delete_volume" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf3f194-3010-49f2-97cc-92f5df8eec8b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d8661f4b-2b4f-40b3-90c8-82803602469f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:03 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 1G" returned: 0 in 0.543s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Acquiring lock "cinder-746e1e98-b6bf-4d0b-8652-d5fb908dc54a-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:03 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d8661f4b-2b4f-40b3-90c8-82803602469f Jul 19 17:42:03 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:03 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 Jul 19 17:42:03 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Lock "cinder-746e1e98-b6bf-4d0b-8652-d5fb908dc54a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Acquiring lock "cinder-quobyte-746e1e98-b6bf-4d0b-8652-d5fb908dc54a" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Lock "cinder-quobyte-746e1e98-b6bf-4d0b-8652-d5fb908dc54a" acquired by "delete_volume" :: waited 0.015s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e17d9a-c0d5-44ac-a4e4-74039467a9ca]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-746e1e98-b6bf-4d0b-8652-d5fb908dc54a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:03 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-746e1e98-b6bf-4d0b-8652-d5fb908dc54a Jul 19 17:42:03 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:03 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d8661f4b-2b4f-40b3-90c8-82803602469f" returned: 0 in 0.440s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d8661f4b-2b4f-40b3-90c8-82803602469f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:03 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d8661f4b-2b4f-40b3-90c8-82803602469f Jul 19 17:42:03 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:03 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62" returned: 0 in 0.432s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:03 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 is being set with open permissions: ugo+rw Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:03 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 Jul 19 17:42:03 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6cd3a753-e366-4e61-93f6-b1f67a79542d tempest-SnapshotsActionsTest-1264436496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:03 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d8661f4b-2b4f-40b3-90c8-82803602469f" returned: 0 in 0.297s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Lock "cinder-quobyte-d8661f4b-2b4f-40b3-90c8-82803602469f" released by "delete_volume" :: held 0.784s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:03 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-746e1e98-b6bf-4d0b-8652-d5fb908dc54a" returned: 0 in 0.483s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-746e1e98-b6bf-4d0b-8652-d5fb908dc54a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:03 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-746e1e98-b6bf-4d0b-8652-d5fb908dc54a Jul 19 17:42:03 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:03 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62" returned: 0 in 0.270s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Created reservations ['a6a3d4d5-2c35-49f6-bce0-ab0cdc625b1d', '3bb083f7-d0c9-434e-9b93-692032277eb4', '61ad55e5-8f7e-457d-ae13-5b63b131e8fa', '2aa2016d-e443-4dcb-88df-0549c7d9ea53'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:04 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.info Jul 19 17:42:04 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:04 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:04 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:04 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-746e1e98-b6bf-4d0b-8652-d5fb908dc54a" returned: 0 in 0.261s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Lock "cinder-quobyte-746e1e98-b6bf-4d0b-8652-d5fb908dc54a" released by "delete_volume" :: held 0.800s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Created reservations ['901e6f4e-a38b-47bc-95c7-06fee173ca75', '57cd28e7-b6a5-4e84-bfc4-bef62c48f392', 'c1be2a42-b75d-4c00-8811-a2d6c11ed15d', '9d8fdd6a-e83c-4af5-af12-8fc1522f0f3d'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:04 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.info" returned: 0 in 0.361s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:04 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.info is being set with open permissions: ugo+rw Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:04 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.info Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:04 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:04 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.341s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:04 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Deleted volume successfully. Jul 19 17:42:04 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:04 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Acquiring lock "cinder-0e9418b9-703c-401e-a4bc-784113b64961-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-475f2bbd-2659-4c8b-b78d-c2e650e85c5d tempest-VolumesActionsTest-1797907957 None] Lock "cinder-d8661f4b-2b4f-40b3-90c8-82803602469f-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Lock "cinder-0e9418b9-703c-401e-a4bc-784113b64961-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Acquiring lock "cinder-quobyte-0e9418b9-703c-401e-a4bc-784113b64961" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Lock "cinder-quobyte-0e9418b9-703c-401e-a4bc-784113b64961" acquired by "delete_volume" :: waited 0.033s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b6fb36-5ab2-48fe-8369-500514472ffd]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0e9418b9-703c-401e-a4bc-784113b64961 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:04 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.info" returned: 0 in 0.349s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.528s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6cd3a753-e366-4e61-93f6-b1f67a79542d tempest-SnapshotsActionsTest-1264436496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.984s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-6cd3a753-e366-4e61-93f6-b1f67a79542d tempest-SnapshotsActionsTest-1264436496 None] Creating offline snapshot 222de6d5-786b-4d50-b19b-77e3f2bd0fdf of volume 7e3820ed-81b0-44c1-86a3-cb13b9a22aea {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:42:04 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0e9418b9-703c-401e-a4bc-784113b64961 Jul 19 17:42:04 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:04 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:04 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-15e0ac6a-3b55-47f7-86c9-06e8bc29e88c tempest-VolumesDeleteCascade-1585903139 None] Create snapshot completed successfully Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7834d3-adb2-47d1-97dc-3e6a6f313c87]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6cd3a753-e366-4e61-93f6-b1f67a79542d tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.479s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:04 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Deleted volume successfully. Jul 19 17:42:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-385d30c0-b109-4864-a68e-d2ed08d4943e tempest-VolumesTestJSON-78238528 None] Lock "cinder-746e1e98-b6bf-4d0b-8652-d5fb908dc54a-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:05 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f Jul 19 17:42:05 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Flow 'volume_create_manager' (e7b189d0-951a-42cc-b644-ea1e62827f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b6baf9-bb5c-4433-8ad3-1d9c9b504ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b6baf9-bb5c-4433-8ad3-1d9c9b504ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-987773537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4915fde4-fa08-4920-906a-bdd9c528f5fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fc996e5d954c3f84d822a1e46af847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:05Z,use_quota=True,user_id='aa3f1429244a436c8afcbb47ff3fc3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4cf3eb-f0ca-46b6-be6b-15b523571875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4cf3eb-f0ca-46b6-be6b-15b523571875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc744a88-e148-4ca6-ade4-0b4c043e20f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc744a88-e148-4ca6-ade4-0b4c043e20f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4915fde4-fa08-4920-906a-bdd9c528f5fb', 'volume_name': 'volume-4915fde4-fa08-4920-906a-bdd9c528f5fb', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ce695f-d970-4091-be76-1f83fb2fa0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:05 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ce695f-d970-4091-be76-1f83fb2fa0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef379ef-0d01-40bc-a63c-490426dfc5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:05 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Volume 4915fde4-fa08-4920-906a-bdd9c528f5fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4915fde4-fa08-4920-906a-bdd9c528f5fb', 'volume_size': 1} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0e9418b9-703c-401e-a4bc-784113b64961" returned: 0 in 0.464s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0e9418b9-703c-401e-a4bc-784113b64961 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:05 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0e9418b9-703c-401e-a4bc-784113b64961 Jul 19 17:42:05 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:05 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6cd3a753-e366-4e61-93f6-b1f67a79542d tempest-SnapshotsActionsTest-1264436496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f" returned: 0 in 0.405s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-6cd3a753-e366-4e61-93f6-b1f67a79542d tempest-SnapshotsActionsTest-1264436496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6cd3a753-e366-4e61-93f6-b1f67a79542d tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:05 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf 1G Jul 19 17:42:05 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:05 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0e9418b9-703c-401e-a4bc-784113b64961" returned: 0 in 0.253s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Lock "cinder-quobyte-0e9418b9-703c-401e-a4bc-784113b64961" released by "delete_volume" :: held 0.774s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Created reservations ['51754bbf-f6d5-44b2-a956-13fea78a79a5', 'e9ad45be-544d-43da-acb6-6beddf8cffde', '83c7c2cf-9584-445e-b080-51e467b2f435', '728c7a01-6590-4f51-b34b-73e8f79b8673'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:05 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:05 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Acquiring lock "cinder-cb1e006e-b972-46f5-b5ae-6dc05094491d-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-550ed588-7fde-4a29-a2a4-5eb6191c8c03 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Lock "cinder-cb1e006e-b972-46f5-b5ae-6dc05094491d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:05 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Acquiring lock "cinder-quobyte-cb1e006e-b972-46f5-b5ae-6dc05094491d" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.302s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:05 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Deleted volume successfully. Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Lock "cinder-quobyte-cb1e006e-b972-46f5-b5ae-6dc05094491d" acquired by "delete_volume" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:05 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6cd3a753-e366-4e61-93f6-b1f67a79542d tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf 1G" returned: 0 in 0.602s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6cd3a753-e366-4e61-93f6-b1f67a79542d tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa6551c-b4fe-4aaa-9282-7c307a1d66fd]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb1e006e-b972-46f5-b5ae-6dc05094491d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:05 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf Jul 19 17:42:05 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a11492e8-4f8c-40e3-bc24-6a0aa50df5f7 tempest-VolumesTestJSON-78238528 None] Lock "cinder-0e9418b9-703c-401e-a4bc-784113b64961-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:06 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb1e006e-b972-46f5-b5ae-6dc05094491d Jul 19 17:42:06 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:06 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6cd3a753-e366-4e61-93f6-b1f67a79542d tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf" returned: 0 in 0.304s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:06 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-6cd3a753-e366-4e61-93f6-b1f67a79542d tempest-SnapshotsActionsTest-1264436496 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf is being set with open permissions: ugo+rw Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6cd3a753-e366-4e61-93f6-b1f67a79542d tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:06 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf Jul 19 17:42:06 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:06 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb1e006e-b972-46f5-b5ae-6dc05094491d" returned: 0 in 0.379s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb1e006e-b972-46f5-b5ae-6dc05094491d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:06 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb1e006e-b972-46f5-b5ae-6dc05094491d Jul 19 17:42:06 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:06 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6cd3a753-e366-4e61-93f6-b1f67a79542d tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf" returned: 0 in 0.245s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6cd3a753-e366-4e61-93f6-b1f67a79542d tempest-SnapshotsActionsTest-1264436496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.709s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.340s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-987773537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4915fde4-fa08-4920-906a-bdd9c528f5fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fc996e5d954c3f84d822a1e46af847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:05Z,use_quota=True,user_id='aa3f1429244a436c8afcbb47ff3fc3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Creating volume 4915fde4-fa08-4920-906a-bdd9c528f5fb {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:06 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4915fde4-fa08-4920-906a-bdd9c528f5fb 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:06 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4915fde4-fa08-4920-906a-bdd9c528f5fb 1073741824 Jul 19 17:42:06 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:06 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-6cd3a753-e366-4e61-93f6-b1f67a79542d tempest-SnapshotsActionsTest-1264436496 None] Create snapshot completed successfully Jul 19 17:42:06 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb1e006e-b972-46f5-b5ae-6dc05094491d" returned: 0 in 0.255s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Lock "cinder-quobyte-cb1e006e-b972-46f5-b5ae-6dc05094491d" released by "delete_volume" :: held 0.691s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Created reservations ['e7c923d4-58d0-49a8-8bb4-18a247d3728b', '53b7c9b1-8dfe-45cf-b7cf-65c5c1227ce5', '48e65776-cb2a-4d87-9d37-332b98a52a7b', '17f4057c-394b-4d32-af0f-b7e2eb1d9f18'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:06 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:06 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:06 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.266s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:06 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4915fde4-fa08-4920-906a-bdd9c528f5fb 1073741824" returned: 0 in 0.471s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:06 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Deleted volume successfully. Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-89a9c4de-6f39-4fd6-9dba-3cc7a40ede43 tempest-VolumesTestJSON-78238528 None] Lock "cinder-cb1e006e-b972-46f5-b5ae-6dc05094491d-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4915fde4-fa08-4920-906a-bdd9c528f5fb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:07 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4915fde4-fa08-4920-906a-bdd9c528f5fb Jul 19 17:42:07 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Acquiring lock "cinder-222de6d5-786b-4d50-b19b-77e3f2bd0fdf-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-222de6d5-786b-4d50-b19b-77e3f2bd0fdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Acquiring lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Acquiring lock "cinder-quobyte-222de6d5-786b-4d50-b19b-77e3f2bd0fdf" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-quobyte-222de6d5-786b-4d50-b19b-77e3f2bd0fdf" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Deleting offline snapshot 222de6d5-786b-4d50-b19b-77e3f2bd0fdf of volume 7e3820ed-81b0-44c1-86a3-cb13b9a22aea {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] snapshot_file for this snap is: volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf961c1-ee3f-4ee1-a0e2-2aca17ccaa40]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:07 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf Jul 19 17:42:07 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:07 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4915fde4-fa08-4920-906a-bdd9c528f5fb" returned: 0 in 0.302s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-550ed588-7fde-4a29-a2a4-5eb6191c8c03 tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.531s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef379ef-0d01-40bc-a63c-490426dfc5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4915fde4-fa08-4920-906a-bdd9c528f5fb', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18de5390-6ca3-438a-b439-05cf4adaaf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-550ed588-7fde-4a29-a2a4-5eb6191c8c03 tempest-VolumesDeleteCascade-1585903139 None] Creating offline snapshot 253fbcbb-38a2-4030-ae0e-49583f2e091a of volume 7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:42:07 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Volume volume-4915fde4-fa08-4920-906a-bdd9c528f5fb (4915fde4-fa08-4920-906a-bdd9c528f5fb): created successfully Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18de5390-6ca3-438a-b439-05cf4adaaf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Flow 'volume_create_manager' (e7b189d0-951a-42cc-b644-ea1e62827f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5464abe-b434-4f2e-be8b-338673fb2146]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-550ed588-7fde-4a29-a2a4-5eb6191c8c03 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:07 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-7025c1fc-bb03-443e-b146-ec6b4595241a tempest-VolumesActionsTest-252368892 None] Created volume successfully. Jul 19 17:42:07 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 Jul 19 17:42:07 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:07 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf" returned: 0 in 0.394s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[49956832-5675-4f1a-bca6-fb4816832873]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:07 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f Jul 19 17:42:07 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:07 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-550ed588-7fde-4a29-a2a4-5eb6191c8c03 tempest-VolumesDeleteCascade-1585903139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62" returned: 0 in 0.398s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-550ed588-7fde-4a29-a2a4-5eb6191c8c03 tempest-VolumesDeleteCascade-1585903139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-550ed588-7fde-4a29-a2a4-5eb6191c8c03 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:07 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a 1G Jul 19 17:42:07 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:07 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f" returned: 0 in 0.387s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:42:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:08 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf Jul 19 17:42:08 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:08 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-550ed588-7fde-4a29-a2a4-5eb6191c8c03 tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a 1G" returned: 0 in 0.582s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-550ed588-7fde-4a29-a2a4-5eb6191c8c03 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:08 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a Jul 19 17:42:08 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:08 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf" returned: 0 in 0.465s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Acquiring lock "cinder-4915fde4-fa08-4920-906a-bdd9c528f5fb-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Lock "cinder-4915fde4-fa08-4920-906a-bdd9c528f5fb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:UPDATE=145,cinder:SELECT=128,cinder:INSERT=28,cinder:DELETE=14 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:42:08 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf Jul 19 17:42:08 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Acquiring lock "cinder-quobyte-4915fde4-fa08-4920-906a-bdd9c528f5fb" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Lock "cinder-quobyte-4915fde4-fa08-4920-906a-bdd9c528f5fb" acquired by "delete_volume" :: waited 0.033s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd4e2eb-b203-4da0-b5b2-17682a49c65d]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4915fde4-fa08-4920-906a-bdd9c528f5fb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:08 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4915fde4-fa08-4920-906a-bdd9c528f5fb Jul 19 17:42:08 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:08 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-550ed588-7fde-4a29-a2a4-5eb6191c8c03 tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a" returned: 0 in 0.392s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:08 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-550ed588-7fde-4a29-a2a4-5eb6191c8c03 tempest-VolumesDeleteCascade-1585903139 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a is being set with open permissions: ugo+rw Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-550ed588-7fde-4a29-a2a4-5eb6191c8c03 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:08 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a Jul 19 17:42:08 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:08 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.222de6d5-786b-4d50-b19b-77e3f2bd0fdf" returned: 0 in 0.409s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-quobyte-222de6d5-786b-4d50-b19b-77e3f2bd0fdf" released by "_delete_snapshot" :: held 1.765s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" released by "delete_snapshot" :: held 1.797s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=131,cinder:UPDATE=149,cinder:DELETE=14,cinder:INSERT=40 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:42:08 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Created reservations ['3b3c9ee9-d3a3-4b01-a0fc-44ae070fdb25', 'eabe133e-1617-4f74-bd3b-293da676e897', '96254419-bc36-4a0e-9ba4-29e5c3bbee1b', 'f85a48b5-1cdb-4b55-b162-3cecbc1cb755'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:09 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Delete snapshot completed successfully. Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9c090250-0332-4e78-9b9c-7b0da731ff0c tempest-SnapshotsActionsTest-1009029829 None] Lock "cinder-222de6d5-786b-4d50-b19b-77e3f2bd0fdf-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:09 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4915fde4-fa08-4920-906a-bdd9c528f5fb" returned: 0 in 0.467s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4915fde4-fa08-4920-906a-bdd9c528f5fb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:09 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-550ed588-7fde-4a29-a2a4-5eb6191c8c03 tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a" returned: 0 in 0.304s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:09 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4915fde4-fa08-4920-906a-bdd9c528f5fb Jul 19 17:42:09 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-550ed588-7fde-4a29-a2a4-5eb6191c8c03 tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:09 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-550ed588-7fde-4a29-a2a4-5eb6191c8c03 tempest-VolumesDeleteCascade-1585903139 None] Create snapshot completed successfully Jul 19 17:42:09 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4915fde4-fa08-4920-906a-bdd9c528f5fb" returned: 0 in 0.286s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Lock "cinder-quobyte-4915fde4-fa08-4920-906a-bdd9c528f5fb" released by "delete_volume" :: held 0.809s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Created reservations ['a004feb2-f9bc-4f03-b844-9cf103ef87ae', '1087d22a-017b-424c-b7be-058322d30030', '25ff64ea-0201-4177-9f2b-e9bdb3708c0f', '07542434-325d-4ced-aee0-73756113f4e3'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:09 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:09 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Acquiring lock "cinder-80083a9a-bcd6-45be-b1b6-6e12f4179a3f-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Lock "cinder-80083a9a-bcd6-45be-b1b6-6e12f4179a3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Acquiring lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Acquiring lock "cinder-quobyte-80083a9a-bcd6-45be-b1b6-6e12f4179a3f" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Lock "cinder-quobyte-80083a9a-bcd6-45be-b1b6-6e12f4179a3f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Deleting offline snapshot 80083a9a-bcd6-45be-b1b6-6e12f4179a3f of volume 7e3820ed-81b0-44c1-86a3-cb13b9a22aea {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] snapshot_file for this snap is: volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb28bf6-2ab8-46c6-aaaa-681c04ebdc2d]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:10 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.466s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:10 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Deleted volume successfully. Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-afcf2433-a560-4634-886f-1b2e61b95732 tempest-VolumesActionsTest-1797907957 None] Lock "cinder-4915fde4-fa08-4920-906a-bdd9c528f5fb-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:10 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f Jul 19 17:42:10 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Performing cascade delete. {{(pid=87676) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-253fbcbb-38a2-4030-ae0e-49583f2e091a-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-253fbcbb-38a2-4030-ae0e-49583f2e091a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-quobyte-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-quobyte-253fbcbb-38a2-4030-ae0e-49583f2e091a" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-253fbcbb-38a2-4030-ae0e-49583f2e091a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Deleting offline snapshot 253fbcbb-38a2-4030-ae0e-49583f2e091a of volume 7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] snapshot_file for this snap is: volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2208ccde-1f81-4da4-b9fa-a20e16d427f1]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:10 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Flow 'volume_create_manager' (a501e6bb-aa8f-4209-9f20-11dd3677031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (651a6f20-48ac-488e-a563-27c53174bb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f" returned: 0 in 0.613s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:42:10 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a Jul 19 17:42:10 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (651a6f20-48ac-488e-a563-27c53174bb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566553475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf07676f-afb9-4a8e-8726-e43c11fcf246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fc996e5d954c3f84d822a1e46af847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:10Z,use_quota=True,user_id='aa3f1429244a436c8afcbb47ff3fc3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1686623-8ea9-4b67-9059-08b718fae89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1686623-8ea9-4b67-9059-08b718fae89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc06444-0131-4de2-8e16-ecc14bbe1165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc06444-0131-4de2-8e16-ecc14bbe1165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf07676f-afb9-4a8e-8726-e43c11fcf246', 'volume_name': 'volume-bf07676f-afb9-4a8e-8726-e43c11fcf246', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127b8e04-beec-402c-8dd0-c58676d31002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127b8e04-beec-402c-8dd0-c58676d31002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76dc6a9-1257-43a7-a71b-e3183ac43fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:10 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Volume bf07676f-afb9-4a8e-8726-e43c11fcf246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf07676f-afb9-4a8e-8726-e43c11fcf246', 'volume_size': 1} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566553475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf07676f-afb9-4a8e-8726-e43c11fcf246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fc996e5d954c3f84d822a1e46af847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:10Z,use_quota=True,user_id='aa3f1429244a436c8afcbb47ff3fc3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Creating volume bf07676f-afb9-4a8e-8726-e43c11fcf246 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:10 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bf07676f-afb9-4a8e-8726-e43c11fcf246 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efb566b-94f6-4ddb-ae25-fc3fe5a6b246]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:10 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bf07676f-afb9-4a8e-8726-e43c11fcf246 1073741824 Jul 19 17:42:10 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:10 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea Jul 19 17:42:10 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:10 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a" returned: 0 in 0.416s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8e3b4c-1ea9-415f-84f1-366bd01d4377]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:11 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 Jul 19 17:42:11 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:11 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" returned: 0 in 0.474s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:11 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f Jul 19 17:42:11 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:11 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bf07676f-afb9-4a8e-8726-e43c11fcf246 1073741824" returned: 0 in 0.595s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bf07676f-afb9-4a8e-8726-e43c11fcf246 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:11 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bf07676f-afb9-4a8e-8726-e43c11fcf246 Jul 19 17:42:11 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:11 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62" returned: 0 in 0.484s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:11 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a Jul 19 17:42:11 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:11 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f" returned: 0 in 0.441s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:11 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f Jul 19 17:42:11 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:11 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bf07676f-afb9-4a8e-8726-e43c11fcf246" returned: 0 in 0.344s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76dc6a9-1257-43a7-a71b-e3183ac43fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf07676f-afb9-4a8e-8726-e43c11fcf246', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb727865-5397-4d04-ae75-47624c708227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:11 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Volume volume-bf07676f-afb9-4a8e-8726-e43c11fcf246 (bf07676f-afb9-4a8e-8726-e43c11fcf246): created successfully Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb727865-5397-4d04-ae75-47624c708227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Flow 'volume_create_manager' (a501e6bb-aa8f-4209-9f20-11dd3677031d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:11 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-6fdbc664-899e-4bbb-bfa3-c410c265781e tempest-VolumesActionsTest-252368892 None] Created volume successfully. Jul 19 17:42:11 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea.80083a9a-bcd6-45be-b1b6-6e12f4179a3f" returned: 0 in 0.295s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:11 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a" returned: 0 in 0.446s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:11 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a Jul 19 17:42:11 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Lock "cinder-quobyte-80083a9a-bcd6-45be-b1b6-6e12f4179a3f" released by "_delete_snapshot" :: held 2.070s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" released by "delete_snapshot" :: held 2.105s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:11 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-63b617a5-82d8-4b82-8969-40e0cc760005 tempest-GroupsTest-864039111 None] Group tempest-Group1-1395004325: creating Jul 19 17:42:12 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-63b617a5-82d8-4b82-8969-40e0cc760005 tempest-GroupsTest-864039111 None] Group tempest-Group1-1395004325: created successfully Jul 19 17:42:12 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-63b617a5-82d8-4b82-8969-40e0cc760005 tempest-GroupsTest-864039111 None] Create group completed successfully. Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Created reservations ['82973c21-c3cf-48e8-9488-71a71f3d9a33', '834bf8f7-4706-4f19-ae85-f704cc7e1d5b', 'c2931c1d-3f5f-499d-8050-a33560784099', 'bc4e4f34-a624-403b-b3c0-6b1999d3f5b1'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:12 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Delete snapshot completed successfully. Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0037449b-8f0e-49e7-b153-9b128b89c1d4 tempest-SnapshotsActionsTest-1264436496 None] Lock "cinder-80083a9a-bcd6-45be-b1b6-6e12f4179a3f-delete_snapshot" released by "delete_snapshot" :: held 2.274s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:12 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.253fbcbb-38a2-4030-ae0e-49583f2e091a" returned: 0 in 0.263s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-253fbcbb-38a2-4030-ae0e-49583f2e091a" released by "_delete_snapshot" :: held 1.756s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe" released by "delete_snapshot" :: held 1.784s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Created reservations ['7f46a299-69aa-4d1d-8e5e-562b54a70929', '051fe1f4-cc52-46a0-8972-9d39db35ac06', '7544c7fa-01f4-4a79-bd80-7d30015687eb', 'caf4f829-841a-41ad-aa80-def5b4fed88b'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:12 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Delete snapshot completed successfully. Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-253fbcbb-38a2-4030-ae0e-49583f2e091a-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-dc2dd591-6b80-4f61-af23-d9962b5f1f62-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-dc2dd591-6b80-4f61-af23-d9962b5f1f62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-quobyte-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-quobyte-dc2dd591-6b80-4f61-af23-d9962b5f1f62" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-dc2dd591-6b80-4f61-af23-d9962b5f1f62" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Deleting offline snapshot dc2dd591-6b80-4f61-af23-d9962b5f1f62 of volume 7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] snapshot_file for this snap is: volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[22323724-9e56-4c29-9859-d8242322caac]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:12 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 Jul 19 17:42:12 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Acquiring lock "cinder-bf07676f-afb9-4a8e-8726-e43c11fcf246-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:12 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62" returned: 0 in 0.362s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Lock "cinder-bf07676f-afb9-4a8e-8726-e43c11fcf246-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[688c6fb6-1e6a-4354-98d8-00f8101f5a7a]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Acquiring lock "cinder-quobyte-bf07676f-afb9-4a8e-8726-e43c11fcf246" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Lock "cinder-quobyte-bf07676f-afb9-4a8e-8726-e43c11fcf246" acquired by "delete_volume" :: waited 0.015s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b537e10d-451f-4645-a2f6-6319f6eb2267]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bf07676f-afb9-4a8e-8726-e43c11fcf246 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:12 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe Jul 19 17:42:12 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:12 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bf07676f-afb9-4a8e-8726-e43c11fcf246 Jul 19 17:42:12 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Acquiring lock "cinder-7e3820ed-81b0-44c1-86a3-cb13b9a22aea-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Lock "cinder-7e3820ed-81b0-44c1-86a3-cb13b9a22aea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Acquiring lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:13 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe" returned: 0 in 0.475s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[be80057d-492d-4c33-b28c-289136eb8df3]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:13 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 Jul 19 17:42:13 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:13 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-bde7a947-17ae-421b-8c30-7ed7cba124b3 tempest-GroupsTest-864039111 None] Group tempest-Group2-1333387885: creating Jul 19 17:42:13 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bf07676f-afb9-4a8e-8726-e43c11fcf246" returned: 0 in 0.462s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bf07676f-afb9-4a8e-8726-e43c11fcf246 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:13 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-bde7a947-17ae-421b-8c30-7ed7cba124b3 tempest-GroupsTest-864039111 None] Group tempest-Group2-1333387885: created successfully Jul 19 17:42:13 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bf07676f-afb9-4a8e-8726-e43c11fcf246 Jul 19 17:42:13 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:13 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-bde7a947-17ae-421b-8c30-7ed7cba124b3 tempest-GroupsTest-864039111 None] Create group completed successfully. Jul 19 17:42:13 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea Jul 19 17:42:13 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:13 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bf07676f-afb9-4a8e-8726-e43c11fcf246" returned: 0 in 0.279s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Lock "cinder-quobyte-bf07676f-afb9-4a8e-8726-e43c11fcf246" released by "delete_volume" :: held 0.778s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:13 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62" returned: 0 in 0.388s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:13 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62 Jul 19 17:42:13 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:13 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" returned: 0 in 0.400s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Created reservations ['870563a8-f45e-4cf5-a2ff-aaf7fd1ff89c', 'bee50f41-8bd3-469d-b3e5-29609c1336c3', 'a99b25fb-35b0-4724-bbf3-3ca2cff494cd', '757b4517-2715-4fa3-af58-85fd652e4c14'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:13 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea Jul 19 17:42:13 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:13 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:13 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:13 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe.dc2dd591-6b80-4f61-af23-d9962b5f1f62" returned: 0 in 0.288s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:13 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" returned: 0 in 0.293s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-dc2dd591-6b80-4f61-af23-d9962b5f1f62" released by "_delete_snapshot" :: held 1.641s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Lock "cinder-quobyte-7e3820ed-81b0-44c1-86a3-cb13b9a22aea" released by "delete_volume" :: held 0.777s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe" released by "delete_snapshot" :: held 1.669s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:14 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.264s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Deleted volume successfully. Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Created reservations ['c78b2ff3-308e-4766-af16-797d8ef5adbb', '35590c3c-0a87-4e86-a6f1-ed14d7df7f42', 'c66e6b9c-7584-41ce-b028-a7f0f511ee2b', '99de3d09-6e09-4d60-be3b-0c11a4eb5038'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Created reservations ['c0f00420-3d2d-44b8-bd60-0af80e093b0b', '9f93208a-5d60-4bf0-bbb7-ac45c37e4527', 'cec387a7-9ab6-48bf-a0de-a71790cb132d', '5860dbf9-7920-4bab-9304-53969094f776'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-42e5a9a9-53f7-4b70-8a3c-b628f925cfec tempest-VolumesActionsTest-1797907957 None] Lock "cinder-bf07676f-afb9-4a8e-8726-e43c11fcf246-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Delete snapshot completed successfully. Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-dc2dd591-6b80-4f61-af23-d9962b5f1f62-delete_snapshot" released by "delete_snapshot" :: held 1.949s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Snapshots deleted, issuing volume delete {{(pid=87676) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 19 17:42:14 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-quobyte-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:14 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe" acquired by "delete_volume" :: waited 0.029s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2a5907-38ec-4cc9-a220-95f8f2189b99]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:14 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe Jul 19 17:42:14 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:14 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.342s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Deleted volume successfully. Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-02694c06-ea2c-490e-ace9-328c761c0c88 tempest-SnapshotsActionsTest-1264436496 None] Lock "cinder-7e3820ed-81b0-44c1-86a3-cb13b9a22aea-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Flow 'volume_create_manager' (e3a0df3b-2669-40c5-9d9f-4d86d4b3318a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6948ea-723e-4bfc-8f22-f22eb6ed1803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6948ea-723e-4bfc-8f22-f22eb6ed1803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1261938530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46c7c22-042d-4597-a7fa-d85384425fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fc996e5d954c3f84d822a1e46af847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:15Z,use_quota=True,user_id='aa3f1429244a436c8afcbb47ff3fc3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818e09c8-e15c-438c-beb6-a5d029c76b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818e09c8-e15c-438c-beb6-a5d029c76b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164e33ca-a3ed-4e39-ad2f-7bf613ea0985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164e33ca-a3ed-4e39-ad2f-7bf613ea0985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f46c7c22-042d-4597-a7fa-d85384425fd8', 'volume_name': 'volume-f46c7c22-042d-4597-a7fa-d85384425fd8', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa0024e-29e3-4211-815c-fd4f2571e920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa0024e-29e3-4211-815c-fd4f2571e920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe405a5-df35-468d-9c10-cf1f5c51ccdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:14 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Volume f46c7c22-042d-4597-a7fa-d85384425fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f46c7c22-042d-4597-a7fa-d85384425fd8', 'volume_size': 1} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1261938530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46c7c22-042d-4597-a7fa-d85384425fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fc996e5d954c3f84d822a1e46af847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:15Z,use_quota=True,user_id='aa3f1429244a436c8afcbb47ff3fc3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Creating volume f46c7c22-042d-4597-a7fa-d85384425fd8 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:14 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f46c7c22-042d-4597-a7fa-d85384425fd8 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:14 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f46c7c22-042d-4597-a7fa-d85384425fd8 1073741824 Jul 19 17:42:14 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:14 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe" returned: 0 in 0.633s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:15 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe Jul 19 17:42:15 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Flow 'volume_create_manager' (8e02c4ea-559b-4698-bf18-dc7eb0be2df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d900bf97-c75c-418e-86b0-412ca6c957f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d900bf97-c75c-418e-86b0-412ca6c957f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-707346515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1c14b86-7dc1-48ca-af74-f1f0becba46b,host='devstack@QuobyteHD#QuobyteHD',id=885f19e6-fe03-4e1c-b46c-2f708538684e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97591ed9b974087a9c9411b4e01826d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:15Z,use_quota=True,user_id='781a0a00e6414a11b2c6b16c41ca87f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1025540e-b389-4608-98ce-543460ad81cd),volume_type_id=1025540e-b389-4608-98ce-543460ad81cd)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7005779d-fdb0-4267-b655-875516e9ea08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7005779d-fdb0-4267-b655-875516e9ea08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb01bbf-ee0b-43f6-a9ea-2b699ef2ac28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:15 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb01bbf-ee0b-43f6-a9ea-2b699ef2ac28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '885f19e6-fe03-4e1c-b46c-2f708538684e', 'volume_name': 'volume-885f19e6-fe03-4e1c-b46c-2f708538684e', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5862be-4758-4e15-9f74-59d18864bee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5862be-4758-4e15-9f74-59d18864bee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb110369-95c8-473e-b096-b8b4e7a10b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:15 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Volume 885f19e6-fe03-4e1c-b46c-2f708538684e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-885f19e6-fe03-4e1c-b46c-2f708538684e', 'volume_size': 1} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe" returned: 0 in 0.344s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe" released by "delete_volume" :: held 1.079s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:15 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f46c7c22-042d-4597-a7fa-d85384425fd8 1073741824" returned: 0 in 0.574s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Created reservations ['5329d4a4-afa6-4114-bac9-7bbaed32172a', '8ba92c4c-027e-4199-bdf5-f84f2d02df83', '4eef506e-c1b7-4862-99c3-21440660c6f9', 'e7abf27c-8978-4ee8-956a-cc2b13546f42'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f46c7c22-042d-4597-a7fa-d85384425fd8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:15 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f46c7c22-042d-4597-a7fa-d85384425fd8 Jul 19 17:42:15 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:15 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:15 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:15 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f46c7c22-042d-4597-a7fa-d85384425fd8" returned: 0 in 0.348s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e1c14b86-7dc1-48ca-af74-f1f0becba46b,created_at=2026-07-19T15:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-707346515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1c14b86-7dc1-48ca-af74-f1f0becba46b,host='devstack@QuobyteHD#QuobyteHD',id=885f19e6-fe03-4e1c-b46c-2f708538684e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97591ed9b974087a9c9411b4e01826d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:15Z,use_quota=True,user_id='781a0a00e6414a11b2c6b16c41ca87f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1025540e-b389-4608-98ce-543460ad81cd),volume_type_id=1025540e-b389-4608-98ce-543460ad81cd)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Creating volume 885f19e6-fe03-4e1c-b46c-2f708538684e {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:15 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-885f19e6-fe03-4e1c-b46c-2f708538684e 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:15 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:15 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-885f19e6-fe03-4e1c-b46c-2f708538684e 1073741824 Jul 19 17:42:15 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe405a5-df35-468d-9c10-cf1f5c51ccdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f46c7c22-042d-4597-a7fa-d85384425fd8', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ee4f49-173c-4e4f-89f5-3d812cfafeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.337s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:15 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Deleted volume successfully. Jul 19 17:42:15 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Volume volume-f46c7c22-042d-4597-a7fa-d85384425fd8 (f46c7c22-042d-4597-a7fa-d85384425fd8): created successfully Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ee4f49-173c-4e4f-89f5-3d812cfafeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Flow 'volume_create_manager' (e3a0df3b-2669-40c5-9d9f-4d86d4b3318a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:15 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f6aa3211-85c6-41af-8efe-e2bb2404bcb3 tempest-VolumesActionsTest-252368892 None] Created volume successfully. Jul 19 17:42:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56d1018e-c054-4ea8-a9dd-149244d5d3c2 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-7afb556c-b3f0-4b93-b1ec-98e09c7d0cfe-delete_volume" released by "delete_volume" :: held 5.757s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:16 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-885f19e6-fe03-4e1c-b46c-2f708538684e 1073741824" returned: 0 in 0.479s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-885f19e6-fe03-4e1c-b46c-2f708538684e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:16 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-885f19e6-fe03-4e1c-b46c-2f708538684e Jul 19 17:42:16 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Flow 'volume_create_manager' (f29f9c82-c97d-4db0-be14-98509748dcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05983db9-6b7d-49cd-b1f2-6684f0824fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05983db9-6b7d-49cd-b1f2-6684f0824fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1229799891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58f011f-9733-427d-ab32-95db05c59479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='766379ba6f1743298f0266f13e4b2423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:16Z,use_quota=True,user_id='e2c61ab293e64e248e12a83da1433c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49d622b-c546-4b6a-bce3-1c80506ddad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49d622b-c546-4b6a-bce3-1c80506ddad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5cd187-aea2-416f-b8b5-b430d23f32e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5cd187-aea2-416f-b8b5-b430d23f32e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b58f011f-9733-427d-ab32-95db05c59479', 'volume_name': 'volume-b58f011f-9733-427d-ab32-95db05c59479', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22bbbfd-ecb1-4b72-824b-8c137058009f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22bbbfd-ecb1-4b72-824b-8c137058009f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0edac5c1-f3af-42c5-beb1-0b0f78fb5c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:16 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Volume b58f011f-9733-427d-ab32-95db05c59479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b58f011f-9733-427d-ab32-95db05c59479', 'volume_size': 1} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:16 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-885f19e6-fe03-4e1c-b46c-2f708538684e" returned: 0 in 0.312s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.035s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1229799891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58f011f-9733-427d-ab32-95db05c59479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='766379ba6f1743298f0266f13e4b2423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:16Z,use_quota=True,user_id='e2c61ab293e64e248e12a83da1433c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Creating volume b58f011f-9733-427d-ab32-95db05c59479 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:16 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:16 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 1073741824 Jul 19 17:42:16 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb110369-95c8-473e-b096-b8b4e7a10b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-885f19e6-fe03-4e1c-b46c-2f708538684e', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7223b6-8c03-4509-ad6f-63db6359a056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:16 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Volume volume-885f19e6-fe03-4e1c-b46c-2f708538684e (885f19e6-fe03-4e1c-b46c-2f708538684e): created successfully Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7223b6-8c03-4509-ad6f-63db6359a056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Flow 'volume_create_manager' (8e02c4ea-559b-4698-bf18-dc7eb0be2df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:16 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-53cbf5ed-5326-4b8a-9698-6eec5777e836 tempest-GroupsTest-864039111 None] Created volume successfully. Jul 19 17:42:17 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 1073741824" returned: 0 in 0.524s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:17 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 Jul 19 17:42:17 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Acquiring lock "cinder-f46c7c22-042d-4597-a7fa-d85384425fd8-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Lock "cinder-f46c7c22-042d-4597-a7fa-d85384425fd8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Acquiring lock "cinder-quobyte-f46c7c22-042d-4597-a7fa-d85384425fd8" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:17 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479" returned: 0 in 0.292s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Lock "cinder-quobyte-f46c7c22-042d-4597-a7fa-d85384425fd8" acquired by "delete_volume" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0edac5c1-f3af-42c5-beb1-0b0f78fb5c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b58f011f-9733-427d-ab32-95db05c59479', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08644680-0cbf-42fc-9e79-8d5b31c0535a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[82593f3d-72f2-4675-a5bc-1ad70308ed22]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f46c7c22-042d-4597-a7fa-d85384425fd8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:17 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Volume volume-b58f011f-9733-427d-ab32-95db05c59479 (b58f011f-9733-427d-ab32-95db05c59479): created successfully Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08644680-0cbf-42fc-9e79-8d5b31c0535a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Flow 'volume_create_manager' (f29f9c82-c97d-4db0-be14-98509748dcab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:17 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-cb518556-696a-43e9-b6bd-d40f77034a0a tempest-VolumesDeleteCascade-1585903139 None] Created volume successfully. Jul 19 17:42:17 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f46c7c22-042d-4597-a7fa-d85384425fd8 Jul 19 17:42:17 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:17 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f46c7c22-042d-4597-a7fa-d85384425fd8" returned: 0 in 0.417s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f46c7c22-042d-4597-a7fa-d85384425fd8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:18 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f46c7c22-042d-4597-a7fa-d85384425fd8 Jul 19 17:42:18 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Acquiring lock "cinder-quobyte-885f19e6-fe03-4e1c-b46c-2f708538684e" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Lock "cinder-quobyte-885f19e6-fe03-4e1c-b46c-2f708538684e" acquired by "delete_volume" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d639a14-cf87-4e29-bf04-63ad4fb7bac0]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-885f19e6-fe03-4e1c-b46c-2f708538684e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:18 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f46c7c22-042d-4597-a7fa-d85384425fd8" returned: 0 in 0.322s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Lock "cinder-quobyte-f46c7c22-042d-4597-a7fa-d85384425fd8" released by "delete_volume" :: held 0.814s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Created reservations ['be45c03f-4935-4874-9a3f-c903b10e4e56', '739f665a-011f-4d83-af35-da10687567bb', 'acf8bac1-fc7f-4125-8329-d659b9cb09ad', 'db1fe922-57f2-4143-817a-e38f4f1af33e'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:18 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-885f19e6-fe03-4e1c-b46c-2f708538684e Jul 19 17:42:18 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:18 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:18 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:18 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-885f19e6-fe03-4e1c-b46c-2f708538684e" returned: 0 in 0.587s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-885f19e6-fe03-4e1c-b46c-2f708538684e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:18 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-885f19e6-fe03-4e1c-b46c-2f708538684e Jul 19 17:42:18 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] Creating offline snapshot 20f012ea-7740-489a-82ec-232655efdd2f of volume b58f011f-9733-427d-ab32-95db05c59479 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:42:18 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.460s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:18 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Deleted volume successfully. Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb52d9cf-afaf-4be1-8190-2726f4d148cb]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3d6d6244-aac4-4296-a1b6-3ed194941ed3 tempest-VolumesActionsTest-252368892 None] Lock "cinder-f46c7c22-042d-4597-a7fa-d85384425fd8-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:19 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 Jul 19 17:42:19 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:19 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-885f19e6-fe03-4e1c-b46c-2f708538684e" returned: 0 in 0.327s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Lock "cinder-quobyte-885f19e6-fe03-4e1c-b46c-2f708538684e" released by "delete_volume" :: held 0.990s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:19 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Created reservations ['dd51c437-bf30-48fe-ba3d-72620d5fba23'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:19 devstack cinder-volume[87676]: WARNING cinder.quota [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1065095289 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1065095289, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:42:19 devstack cinder-volume[87676]: WARNING cinder.quota [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1065095289 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1065095289, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:42:19 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Created reservations ['457ef4b0-3bc0-4c27-a542-7cedf8f0d63e', '5c93c203-518a-46e5-ab83-62c11c7b050d', '4afd0c6d-bdda-4191-9847-d7bcc14f9244', '912d1a28-065b-48bf-8ce7-44d0381d0865'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:19 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479" returned: 0 in 0.540s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:19 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:19 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:19 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f 1G Jul 19 17:42:19 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:19 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.373s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:19 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:19 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-23956068-9f22-4c5f-b1e1-d070b597283c tempest-GroupsTest-864039111 None] Delete group completed successfully. Jul 19 17:42:20 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f 1G" returned: 0 in 0.536s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b58f011f-9733-427d-ab32-95db05c59479 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:20 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b58f011f-9733-427d-ab32-95db05c59479 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f Jul 19 17:42:20 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:20 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b58f011f-9733-427d-ab32-95db05c59479 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f" returned: 0 in 0.322s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:20 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f is being set with open permissions: ugo+rw Jul 19 17:42:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:20 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f Jul 19 17:42:20 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:20 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:20 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-c8183a52-397b-4df0-b802-596e0f9dfac3 tempest-GroupsTest-864039111 None] Created reservations ['e206dbc7-c4cf-4aa6-8165-9f8abec8c019'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f" returned: 0 in 0.326s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:20 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.info Jul 19 17:42:20 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c8183a52-397b-4df0-b802-596e0f9dfac3 tempest-GroupsTest-864039111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c8183a52-397b-4df0-b802-596e0f9dfac3 tempest-GroupsTest-864039111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c8183a52-397b-4df0-b802-596e0f9dfac3 tempest-GroupsTest-864039111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c8183a52-397b-4df0-b802-596e0f9dfac3 tempest-GroupsTest-864039111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c8183a52-397b-4df0-b802-596e0f9dfac3 tempest-GroupsTest-864039111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c8183a52-397b-4df0-b802-596e0f9dfac3 tempest-GroupsTest-864039111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:20 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:20 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:21 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c8183a52-397b-4df0-b802-596e0f9dfac3 tempest-GroupsTest-864039111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.256s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:21 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-c8183a52-397b-4df0-b802-596e0f9dfac3 tempest-GroupsTest-864039111 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:21 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c8183a52-397b-4df0-b802-596e0f9dfac3 tempest-GroupsTest-864039111 None] Delete group completed successfully. Jul 19 17:42:21 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.info" returned: 0 in 0.325s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:21 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.info is being set with open permissions: ugo+rw Jul 19 17:42:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:21 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.info Jul 19 17:42:21 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:21 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.info" returned: 0 in 0.272s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.472s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:21 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c3547409-27d1-449e-86b2-a2444db4eb1d tempest-VolumesDeleteCascade-1585903139 None] Create snapshot completed successfully Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Flow 'volume_create_manager' (209ba4e4-f621-4785-a69e-81fa9d135a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00338b9-612a-4611-b7fe-ec65d90a2a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00338b9-612a-4611-b7fe-ec65d90a2a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-423921089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d424775f-5801-4653-9942-99d357bd7b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f1d92a0cf2412aabb950c2f03c5872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:22Z,use_quota=True,user_id='0651483712ba46acb054b04ac7854009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac4178d-71fb-43c5-81ca-8c74778afa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac4178d-71fb-43c5-81ca-8c74778afa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d40d5e-e729-4b03-85b3-1f954de46b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d40d5e-e729-4b03-85b3-1f954de46b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd424775f-5801-4653-9942-99d357bd7b78', 'volume_name': 'volume-d424775f-5801-4653-9942-99d357bd7b78', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c3ef47-808b-44b8-8c1d-38eb0518ce3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c3ef47-808b-44b8-8c1d-38eb0518ce3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671c0710-9863-451b-8725-447a1851481f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:22 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Volume d424775f-5801-4653-9942-99d357bd7b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d424775f-5801-4653-9942-99d357bd7b78', 'volume_size': 1} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-423921089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d424775f-5801-4653-9942-99d357bd7b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f1d92a0cf2412aabb950c2f03c5872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:22Z,use_quota=True,user_id='0651483712ba46acb054b04ac7854009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Creating volume d424775f-5801-4653-9942-99d357bd7b78 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:22 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d424775f-5801-4653-9942-99d357bd7b78 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:22 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d424775f-5801-4653-9942-99d357bd7b78 1073741824 Jul 19 17:42:22 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:22 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9a6cfbc9-d7e4-49a2-8d8e-6cbc5c6a2918 tempest-GroupsTest-864039111 None] Group tempest-GroupsTest-Group-1324648971: creating Jul 19 17:42:22 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9a6cfbc9-d7e4-49a2-8d8e-6cbc5c6a2918 tempest-GroupsTest-864039111 None] Group tempest-GroupsTest-Group-1324648971: created successfully Jul 19 17:42:22 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9a6cfbc9-d7e4-49a2-8d8e-6cbc5c6a2918 tempest-GroupsTest-864039111 None] Create group completed successfully. Jul 19 17:42:22 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Flow 'volume_create_manager' (9d8b171a-2f9b-447b-a5a2-fc83074b6715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60909034-e493-4827-8990-931770dc789a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60909034-e493-4827-8990-931770dc789a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1994376355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff524d9-e3c9-4506-9bb3-85380c77ccd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='766379ba6f1743298f0266f13e4b2423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=20f012ea-7740-489a-82ec-232655efdd2f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:23Z,use_quota=True,user_id='e2c61ab293e64e248e12a83da1433c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce7640c-c889-43da-bb46-a62556efbd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce7640c-c889-43da-bb46-a62556efbd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ba2d29-c0ad-49e5-bf9a-c9c884d72e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ba2d29-c0ad-49e5-bf9a-c9c884d72e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aff524d9-e3c9-4506-9bb3-85380c77ccd4', 'volume_name': 'volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4', 'volume_size': 1, 'snapshot_id': '20f012ea-7740-489a-82ec-232655efdd2f'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02035bb-9358-44f3-bb0b-fcec6250842f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02035bb-9358-44f3-bb0b-fcec6250842f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0bbc9b0-fbe6-4be6-ab97-e44bab646a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:23 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Volume aff524d9-e3c9-4506-9bb3-85380c77ccd4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4', 'volume_size': 1, 'snapshot_id': '20f012ea-7740-489a-82ec-232655efdd2f'} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:23 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d424775f-5801-4653-9942-99d357bd7b78 1073741824" returned: 0 in 0.593s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d424775f-5801-4653-9942-99d357bd7b78 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:23 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d424775f-5801-4653-9942-99d357bd7b78 Jul 19 17:42:23 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:23 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d424775f-5801-4653-9942-99d357bd7b78" returned: 0 in 0.252s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.305s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-quobyte-20f012ea-7740-489a-82ec-232655efdd2f-aff524d9-e3c9-4506-9bb3-85380c77ccd4" by "_create_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671c0710-9863-451b-8725-447a1851481f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d424775f-5801-4653-9942-99d357bd7b78', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff263fe1-76b0-48b7-b9f0-82bbd7982df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-20f012ea-7740-489a-82ec-232655efdd2f-aff524d9-e3c9-4506-9bb3-85380c77ccd4" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Creating volume aff524d9-e3c9-4506-9bb3-85380c77ccd4 from snapshot 20f012ea-7740-489a-82ec-232655efdd2f {{(pid=87676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-quobyte-aff524d9-e3c9-4506-9bb3-85380c77ccd4" by "_copy_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:23 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Volume volume-d424775f-5801-4653-9942-99d357bd7b78 (d424775f-5801-4653-9942-99d357bd7b78): created successfully Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff263fe1-76b0-48b7-b9f0-82bbd7982df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Flow 'volume_create_manager' (209ba4e4-f621-4785-a69e-81fa9d135a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-7bf90038-38f3-401b-89cd-6763998b5879 tempest-VolumeQuotasAdminTestJSON-321365792 None] Created volume successfully. Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-aff524d9-e3c9-4506-9bb3-85380c77ccd4" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] snapshot: 20f012ea-7740-489a-82ec-232655efdd2f, volume: aff524d9-e3c9-4506-9bb3-85380c77ccd4, {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed25f138-9b3c-4204-b83c-7091787101e7]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:23 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f Jul 19 17:42:23 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:23 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f" returned: 0 in 0.397s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b58f011f-9733-427d-ab32-95db05c59479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] will copy from snapshot at /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Creating direct copy from snapshot {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f769824-1977-483a-a327-fc307b811c2c]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:24 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 Jul 19 17:42:24 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Flow 'volume_create_manager' (efb7e635-74a2-4e0e-9a0e-470f11b8cefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f039670-f5c9-4c8d-950f-0bc89e30ae1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f039670-f5c9-4c8d-950f-0bc89e30ae1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-577261143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3747e7ef-0e2e-4aca-993c-0ed82385051f,host='devstack@QuobyteHD#QuobyteHD',id=8d1d69ae-cea3-4c9e-a412-d73ce13c538b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97591ed9b974087a9c9411b4e01826d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:24Z,use_quota=True,user_id='781a0a00e6414a11b2c6b16c41ca87f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095122e5-de61-41f1-a5d7-6f72694b6d7e),volume_type_id=095122e5-de61-41f1-a5d7-6f72694b6d7e)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36bc6b50-07dd-4ca3-ae27-0210f56722f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36bc6b50-07dd-4ca3-ae27-0210f56722f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe43e3de-0947-45ce-9d5b-4e230fa94f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe43e3de-0947-45ce-9d5b-4e230fa94f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d1d69ae-cea3-4c9e-a412-d73ce13c538b', 'volume_name': 'volume-8d1d69ae-cea3-4c9e-a412-d73ce13c538b', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acac6fe2-11b0-48f2-a7e4-2996090b1538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acac6fe2-11b0-48f2-a7e4-2996090b1538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e511f7de-fb75-4570-b835-8d42f9b1a39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:24 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Volume 8d1d69ae-cea3-4c9e-a412-d73ce13c538b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d1d69ae-cea3-4c9e-a412-d73ce13c538b', 'volume_size': 1} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:24 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479" returned: 0 in 0.466s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG cinder.utils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Path /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4 not found in is_blk_device check {{(pid=87676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:24 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4 Jul 19 17:42:24 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Acquiring lock "cinder-d424775f-5801-4653-9942-99d357bd7b78-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Lock "cinder-d424775f-5801-4653-9942-99d357bd7b78-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Acquiring lock "cinder-quobyte-d424775f-5801-4653-9942-99d357bd7b78" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Lock "cinder-quobyte-d424775f-5801-4653-9942-99d357bd7b78" acquired by "delete_volume" :: waited 0.031s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c9cd53-d447-40ae-bb8a-3df1500c95da]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d424775f-5801-4653-9942-99d357bd7b78 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:24 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d424775f-5801-4653-9942-99d357bd7b78 Jul 19 17:42:24 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:25 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d424775f-5801-4653-9942-99d357bd7b78" returned: 0 in 0.489s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d424775f-5801-4653-9942-99d357bd7b78 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:25 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d424775f-5801-4653-9942-99d357bd7b78 Jul 19 17:42:25 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:25 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d424775f-5801-4653-9942-99d357bd7b78" returned: 0 in 0.738s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Lock "cinder-quobyte-d424775f-5801-4653-9942-99d357bd7b78" released by "delete_volume" :: held 1.287s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:26 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Created reservations ['156ee15b-816f-44fa-84fa-87aef2eb2e32', 'de9a1165-cb58-4ced-a73a-0c0fb0c5e7dd', 'f4862416-3262-471b-99f4-d8c0701cabda', '02ac5877-bb3a-44b4-aab4-76db141d3975'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:26 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:26 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:26 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.326s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:26 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:26 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Deleted volume successfully. Jul 19 17:42:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e9486f2a-34c5-4fb7-b571-4f269f4927a4 tempest-VolumeQuotasAdminTestJSON-321365792 None] Lock "cinder-d424775f-5801-4653-9942-99d357bd7b78-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:29 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:42:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Flow 'volume_create_manager' (db4e2f0c-2fcf-4495-8487-a4782c11e149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0152210-511c-4f14-8362-f12a08bc8a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0152210-511c-4f14-8362-f12a08bc8a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1705718568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f1d92a0cf2412aabb950c2f03c5872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:29Z,use_quota=True,user_id='0651483712ba46acb054b04ac7854009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ceec84-6351-465a-8b32-aa5afa3009a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ceec84-6351-465a-8b32-aa5afa3009a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f55b60-896c-4536-8242-6578ac68d2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f55b60-896c-4536-8242-6578ac68d2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676', 'volume_name': 'volume-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fb4650-ae15-4a1a-bbea-4a6ba9515214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fb4650-ae15-4a1a-bbea-4a6ba9515214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac71ba9e-2e82-4d1f-b621-ea04683647c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:29 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Volume f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676', 'volume_size': 1} Jul 19 17:42:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:29 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4" returned: 0 in 5.469s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:29 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b677515f-9216-41de-9146-98cce922095a]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:30 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 Jul 19 17:42:30 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:30 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479" returned: 0 in 0.577s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Image conversion details: src /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479, size 1024.00 MB, duration 5.47 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:42:30 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Converted 1024.00 MB image at 187.20 MB/s Jul 19 17:42:30 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4 is being set with open permissions: ugo+rw Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:30 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4 Jul 19 17:42:30 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:30 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4" returned: 0 in 0.254s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-aff524d9-e3c9-4506-9bb3-85380c77ccd4" released by "_copy_volume_from_snapshot" :: held 7.275s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-20f012ea-7740-489a-82ec-232655efdd2f-aff524d9-e3c9-4506-9bb3-85380c77ccd4" released by "_create_volume_from_snapshot" :: held 7.343s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.377s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.378s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3747e7ef-0e2e-4aca-993c-0ed82385051f,created_at=2026-07-19T15:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-577261143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3747e7ef-0e2e-4aca-993c-0ed82385051f,host='devstack@QuobyteHD#QuobyteHD',id=8d1d69ae-cea3-4c9e-a412-d73ce13c538b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97591ed9b974087a9c9411b4e01826d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:24Z,use_quota=True,user_id='781a0a00e6414a11b2c6b16c41ca87f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095122e5-de61-41f1-a5d7-6f72694b6d7e),volume_type_id=095122e5-de61-41f1-a5d7-6f72694b6d7e)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Creating volume 8d1d69ae-cea3-4c9e-a412-d73ce13c538b {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:30 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8d1d69ae-cea3-4c9e-a412-d73ce13c538b 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:30 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8d1d69ae-cea3-4c9e-a412-d73ce13c538b 1073741824 Jul 19 17:42:30 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0bbc9b0-fbe6-4be6-ab97-e44bab646a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4', 'volume_size': 1, 'snapshot_id': '20f012ea-7740-489a-82ec-232655efdd2f'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56737591-0343-4212-9928-5a4332e7804c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:30 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Volume volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4 (aff524d9-e3c9-4506-9bb3-85380c77ccd4): created successfully Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56737591-0343-4212-9928-5a4332e7804c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Flow 'volume_create_manager' (9d8b171a-2f9b-447b-a5a2-fc83074b6715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:30 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f0fd7ce0-8a0d-4a1f-806d-56070f1afde8 tempest-VolumesDeleteCascade-1585903139 None] Created volume successfully. Jul 19 17:42:31 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8d1d69ae-cea3-4c9e-a412-d73ce13c538b 1073741824" returned: 0 in 0.477s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8d1d69ae-cea3-4c9e-a412-d73ce13c538b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:31 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8d1d69ae-cea3-4c9e-a412-d73ce13c538b Jul 19 17:42:31 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:31 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8d1d69ae-cea3-4c9e-a412-d73ce13c538b" returned: 0 in 0.269s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.245s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1705718568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f1d92a0cf2412aabb950c2f03c5872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:29Z,use_quota=True,user_id='0651483712ba46acb054b04ac7854009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Creating volume f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:31 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:31 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676 1073741824 Jul 19 17:42:31 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e511f7de-fb75-4570-b835-8d42f9b1a39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d1d69ae-cea3-4c9e-a412-d73ce13c538b', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710c76cd-ac25-44d4-9376-d1b98f7de1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:31 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Volume volume-8d1d69ae-cea3-4c9e-a412-d73ce13c538b (8d1d69ae-cea3-4c9e-a412-d73ce13c538b): created successfully Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710c76cd-ac25-44d4-9376-d1b98f7de1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Flow 'volume_create_manager' (efb7e635-74a2-4e0e-9a0e-470f11b8cefc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:31 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-d2511cd3-9f2c-4db1-8452-d013423e9ee1 tempest-GroupsTest-864039111 None] Created volume successfully. Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-b58f011f-9733-427d-ab32-95db05c59479-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-b58f011f-9733-427d-ab32-95db05c59479-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Performing cascade delete. {{(pid=87676) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-20f012ea-7740-489a-82ec-232655efdd2f-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:32 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676 1073741824" returned: 0 in 0.545s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-20f012ea-7740-489a-82ec-232655efdd2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-quobyte-b58f011f-9733-427d-ab32-95db05c59479" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-b58f011f-9733-427d-ab32-95db05c59479" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-quobyte-20f012ea-7740-489a-82ec-232655efdd2f" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-20f012ea-7740-489a-82ec-232655efdd2f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Deleting offline snapshot 20f012ea-7740-489a-82ec-232655efdd2f of volume b58f011f-9733-427d-ab32-95db05c59479 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:42:32 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676 Jul 19 17:42:32 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] snapshot_file for this snap is: volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a48c7c-8d6c-44fe-a7df-8848d1be49af]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:32 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f Jul 19 17:42:32 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:32 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676" returned: 0 in 0.270s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac71ba9e-2e82-4d1f-b621-ea04683647c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6306c515-54ab-4de3-b9c1-3ff5f001bd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:32 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Volume volume-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676 (f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676): created successfully Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6306c515-54ab-4de3-b9c1-3ff5f001bd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Flow 'volume_create_manager' (db4e2f0c-2fcf-4495-8487-a4782c11e149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a76cd6cb-2c1d-4704-ad44-ce08ee60f16d tempest-VolumeQuotasAdminTestJSON-321365792 None] Created volume successfully. Jul 19 17:42:32 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f" returned: 0 in 0.397s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b58f011f-9733-427d-ab32-95db05c59479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[825f7753-ce62-4c2d-9f88-7d79bbd28ce9]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:32 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 Jul 19 17:42:32 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:33 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479" returned: 0 in 0.468s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:33 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f Jul 19 17:42:33 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Flow 'volume_create_manager' (7602e0c2-cfb8-4fdf-8384-bfbc65218c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b423d1-6835-497f-9f0c-dd0136ca2ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b423d1-6835-497f-9f0c-dd0136ca2ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-727323840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3747e7ef-0e2e-4aca-993c-0ed82385051f,host='devstack@QuobyteHD#QuobyteHD',id=2ed4e210-d108-44b3-8005-0f4871bb1028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97591ed9b974087a9c9411b4e01826d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:33Z,use_quota=True,user_id='781a0a00e6414a11b2c6b16c41ca87f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095122e5-de61-41f1-a5d7-6f72694b6d7e),volume_type_id=095122e5-de61-41f1-a5d7-6f72694b6d7e)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19866a05-a09f-4dff-b36d-152f60fe89d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19866a05-a09f-4dff-b36d-152f60fe89d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c39c8d-17ec-488d-a91e-357ac185fd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c39c8d-17ec-488d-a91e-357ac185fd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ed4e210-d108-44b3-8005-0f4871bb1028', 'volume_name': 'volume-2ed4e210-d108-44b3-8005-0f4871bb1028', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf49edf-b1be-4050-912e-8a80cc6768d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf49edf-b1be-4050-912e-8a80cc6768d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c4f610-d678-47f1-9145-1c756abfe7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:33 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Volume 2ed4e210-d108-44b3-8005-0f4871bb1028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ed4e210-d108-44b3-8005-0f4871bb1028', 'volume_size': 1} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3747e7ef-0e2e-4aca-993c-0ed82385051f,created_at=2026-07-19T15:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-727323840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3747e7ef-0e2e-4aca-993c-0ed82385051f,host='devstack@QuobyteHD#QuobyteHD',id=2ed4e210-d108-44b3-8005-0f4871bb1028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97591ed9b974087a9c9411b4e01826d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:33Z,use_quota=True,user_id='781a0a00e6414a11b2c6b16c41ca87f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095122e5-de61-41f1-a5d7-6f72694b6d7e),volume_type_id=095122e5-de61-41f1-a5d7-6f72694b6d7e)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Creating volume 2ed4e210-d108-44b3-8005-0f4871bb1028 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:33 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2ed4e210-d108-44b3-8005-0f4871bb1028 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:33 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2ed4e210-d108-44b3-8005-0f4871bb1028 1073741824 Jul 19 17:42:33 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:33 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f" returned: 0 in 0.451s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:33 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f Jul 19 17:42:33 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:33 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479.20f012ea-7740-489a-82ec-232655efdd2f" returned: 0 in 0.351s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-20f012ea-7740-489a-82ec-232655efdd2f" released by "_delete_snapshot" :: held 1.785s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:33 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-b58f011f-9733-427d-ab32-95db05c59479" released by "delete_snapshot" :: held 1.822s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2ed4e210-d108-44b3-8005-0f4871bb1028 1073741824" returned: 0 in 0.623s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2ed4e210-d108-44b3-8005-0f4871bb1028 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:34 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-e2e3a862-e0ff-412b-990a-688e9a6abbc2 tempest-VolumeQuotasAdminTestJSON-1949632802 None] Transfer volume completed successfully. Jul 19 17:42:34 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2ed4e210-d108-44b3-8005-0f4871bb1028 Jul 19 17:42:34 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Created reservations ['3f9b12f0-fdc3-4a7b-88d6-31214e3741f6', '899e84e0-ca14-4424-88da-6a4cb19ca5cb', '8cd24224-413c-4d4e-ad09-4e3f036f6b1f', '74484a62-07aa-4b49-8bb5-f6349835037a'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:34 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Delete snapshot completed successfully. Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-20f012ea-7740-489a-82ec-232655efdd2f-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Snapshots deleted, issuing volume delete {{(pid=87676) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-quobyte-b58f011f-9733-427d-ab32-95db05c59479" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-b58f011f-9733-427d-ab32-95db05c59479" acquired by "delete_volume" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[067ba298-b6d5-4096-b642-68a416ba00e4]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:34 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2ed4e210-d108-44b3-8005-0f4871bb1028" returned: 0 in 0.335s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:34 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:34 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c4f610-d678-47f1-9145-1c756abfe7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ed4e210-d108-44b3-8005-0f4871bb1028', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584db701-aeb7-4380-b24e-35a7bca9c7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:34 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Volume volume-2ed4e210-d108-44b3-8005-0f4871bb1028 (2ed4e210-d108-44b3-8005-0f4871bb1028): created successfully Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584db701-aeb7-4380-b24e-35a7bca9c7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Flow 'volume_create_manager' (7602e0c2-cfb8-4fdf-8384-bfbc65218c77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:34 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-4f59bb0b-0b37-4bb5-b9ee-769f0567ce99 tempest-GroupsTest-864039111 None] Created volume successfully. Jul 19 17:42:34 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479" returned: 0 in 0.437s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:34 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479 Jul 19 17:42:34 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:34 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-6da3ff91-6eb1-4083-a5a0-7bb0265f8fc9 tempest-GroupsTest-864039111 None] Update group completed successfully. Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Flow 'volume_create_manager' (83b531c9-f534-4fb5-96e7-7964252d3610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a5bf52-4859-4592-9417-0dcef561848a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a5bf52-4859-4592-9417-0dcef561848a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-802334938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dea89fe-587a-4922-91e9-4873428f07b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895827130e6243dda4d395290349bd7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:35Z,use_quota=True,user_id='fcedff3465064abb9f190f392ff7aa59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e821f3e-bd01-47a8-af36-f4f05773c609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e821f3e-bd01-47a8-af36-f4f05773c609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09013662-8fa9-420f-a406-6fff3c021475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09013662-8fa9-420f-a406-6fff3c021475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dea89fe-587a-4922-91e9-4873428f07b5', 'volume_name': 'volume-7dea89fe-587a-4922-91e9-4873428f07b5', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ced2e7-0cec-4e2e-95c3-9433b386f88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ced2e7-0cec-4e2e-95c3-9433b386f88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780d435a-24f0-4c3e-94d3-79e0287162bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:34 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Volume 7dea89fe-587a-4922-91e9-4873428f07b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dea89fe-587a-4922-91e9-4873428f07b5', 'volume_size': 1} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-802334938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dea89fe-587a-4922-91e9-4873428f07b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895827130e6243dda4d395290349bd7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:35Z,use_quota=True,user_id='fcedff3465064abb9f190f392ff7aa59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Creating volume 7dea89fe-587a-4922-91e9-4873428f07b5 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:34 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7dea89fe-587a-4922-91e9-4873428f07b5 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:34 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7dea89fe-587a-4922-91e9-4873428f07b5 1073741824 Jul 19 17:42:34 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Acquiring lock "cinder-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:34 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:34 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Lock "cinder-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:35 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b58f011f-9733-427d-ab32-95db05c59479" returned: 0 in 0.360s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Acquiring lock "cinder-quobyte-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-b58f011f-9733-427d-ab32-95db05c59479" released by "delete_volume" :: held 0.894s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Lock "cinder-quobyte-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b817615-c75b-43f8-a077-a676d49b6b76]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Created reservations ['9d19cf5c-802e-45e2-a191-0762860265bd', 'e8189c86-04a3-42ac-8f1f-137d28f0ebdc', '09d32fd3-847e-4c30-bd9b-02e690057d71', 'f0ddcf72-b4cb-408f-9e38-229bc1843c16'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:35 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676 Jul 19 17:42:35 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:35 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.286s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:35 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:35 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 8 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:42:35 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7dea89fe-587a-4922-91e9-4873428f07b5 1073741824" returned: 0 in 0.480s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7dea89fe-587a-4922-91e9-4873428f07b5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:35 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7dea89fe-587a-4922-91e9-4873428f07b5 Jul 19 17:42:35 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:35 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.279s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:35 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Deleted volume successfully. Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f3ec2721-b25d-457c-b6dc-222d6726284e tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-b58f011f-9733-427d-ab32-95db05c59479-delete_volume" released by "delete_volume" :: held 3.500s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:35 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676" returned: 0 in 0.472s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:35 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676 Jul 19 17:42:35 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-aff524d9-e3c9-4506-9bb3-85380c77ccd4-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-aff524d9-e3c9-4506-9bb3-85380c77ccd4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:35 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7dea89fe-587a-4922-91e9-4873428f07b5" returned: 0 in 0.303s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "cinder-quobyte-aff524d9-e3c9-4506-9bb3-85380c77ccd4" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780d435a-24f0-4c3e-94d3-79e0287162bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dea89fe-587a-4922-91e9-4873428f07b5', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa216b1c-0ff8-4496-8bf9-d6cc1ff2966d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-aff524d9-e3c9-4506-9bb3-85380c77ccd4" acquired by "delete_volume" :: waited 0.035s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:35 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Volume volume-7dea89fe-587a-4922-91e9-4873428f07b5 (7dea89fe-587a-4922-91e9-4873428f07b5): created successfully Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa216b1c-0ff8-4496-8bf9-d6cc1ff2966d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Flow 'volume_create_manager' (83b531c9-f534-4fb5-96e7-7964252d3610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:35 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1866c03b-12c2-492c-b367-4a71fe97386b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676" returned: 0 in 0.305s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:35 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-4000097d-f466-4e6d-a50e-84288b729179 tempest-AbsoluteLimitsTests-1657580524 None] Created volume successfully. Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Lock "cinder-quobyte-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676" released by "delete_volume" :: held 0.832s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:35 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Created reservations ['bfe71828-a523-40f9-b241-99983c55b024', '2930ea57-5292-44e0-9454-6d0e4fc245e6', 'eb8c6313-98f5-4a74-8af6-91e14f5671d1', 'ef233e6d-42ca-431c-833e-0f5193cbde92'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:35 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4 Jul 19 17:42:35 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:36 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:36 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:36 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-fcafd4e0-7e5d-46c3-966d-439196630339 tempest-GroupsTest-864039111 None] Update group completed successfully. Jul 19 17:42:36 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4" returned: 0 in 0.457s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:36 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4 Jul 19 17:42:36 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:36 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.330s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:36 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Deleted volume successfully. Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4cce8c1d-df43-4ade-9872-7b44cb09b85f tempest-VolumeQuotasAdminTestJSON-1649777025 None] Lock "cinder-f4936ea7-ac6a-4fbb-8ba7-204eaa7d4676-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:36 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aff524d9-e3c9-4506-9bb3-85380c77ccd4" returned: 0 in 0.268s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-quobyte-aff524d9-e3c9-4506-9bb3-85380c77ccd4" released by "delete_volume" :: held 0.787s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Created reservations ['2941741a-3931-40f2-a0ba-d1f07f3efaae', 'b4c42f1f-0b8c-4aa9-a834-9035321093f1', '44cae099-c877-45cd-946a-1de8a0c4bc3d', '1f1315cd-fff7-4de2-800c-167e96b439e8'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:36 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:36 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:36 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.278s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:37 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:37 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Deleted volume successfully. Jul 19 17:42:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ee0a80c6-521e-416e-a31f-b404426a7bf6 tempest-VolumesDeleteCascade-1585903139 None] Lock "cinder-aff524d9-e3c9-4506-9bb3-85380c77ccd4-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Acquiring lock "cinder-7dea89fe-587a-4922-91e9-4873428f07b5-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Lock "cinder-7dea89fe-587a-4922-91e9-4873428f07b5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Acquiring lock "cinder-quobyte-7dea89fe-587a-4922-91e9-4873428f07b5" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Lock "cinder-quobyte-7dea89fe-587a-4922-91e9-4873428f07b5" acquired by "delete_volume" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:37 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b38f8b-f3d9-452c-940c-c21797ffb19f]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7dea89fe-587a-4922-91e9-4873428f07b5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:37 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7dea89fe-587a-4922-91e9-4873428f07b5 Jul 19 17:42:37 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:37 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7dea89fe-587a-4922-91e9-4873428f07b5" returned: 0 in 0.469s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7dea89fe-587a-4922-91e9-4873428f07b5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:37 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7dea89fe-587a-4922-91e9-4873428f07b5 Jul 19 17:42:37 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Acquiring lock "cinder-quobyte-2ed4e210-d108-44b3-8005-0f4871bb1028" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Lock "cinder-quobyte-2ed4e210-d108-44b3-8005-0f4871bb1028" acquired by "delete_volume" :: waited 0.034s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:38 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ce86bf-15a5-40ff-87ef-174f2329f0db]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2ed4e210-d108-44b3-8005-0f4871bb1028 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7dea89fe-587a-4922-91e9-4873428f07b5" returned: 0 in 0.306s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Lock "cinder-quobyte-7dea89fe-587a-4922-91e9-4873428f07b5" released by "delete_volume" :: held 0.846s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Created reservations ['efa63491-fe9d-4626-ac00-43dbd626f48b', '28b13251-a428-44a0-8e04-4a3d00561040', '09f5e692-b81c-44b2-b4d9-521dfffbc3c1', '8f8a7183-5e0b-4920-9d65-442aaba73ab2'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:38 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2ed4e210-d108-44b3-8005-0f4871bb1028 Jul 19 17:42:38 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:38 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:38 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:38 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2ed4e210-d108-44b3-8005-0f4871bb1028" returned: 0 in 0.590s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2ed4e210-d108-44b3-8005-0f4871bb1028 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:38 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.352s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:38 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Deleted volume successfully. Jul 19 17:42:38 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2ed4e210-d108-44b3-8005-0f4871bb1028 Jul 19 17:42:38 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-88fd5045-5cf7-416d-b687-c8c0da134c1d tempest-AbsoluteLimitsTests-1657580524 None] Lock "cinder-7dea89fe-587a-4922-91e9-4873428f07b5-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:39 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2ed4e210-d108-44b3-8005-0f4871bb1028" returned: 0 in 0.397s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Lock "cinder-quobyte-2ed4e210-d108-44b3-8005-0f4871bb1028" released by "delete_volume" :: held 1.052s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Acquiring lock "cinder-quobyte-8d1d69ae-cea3-4c9e-a412-d73ce13c538b" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Lock "cinder-quobyte-8d1d69ae-cea3-4c9e-a412-d73ce13c538b" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:39 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f12f2e3-67d3-4903-a7a9-215a15cbbc68]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8d1d69ae-cea3-4c9e-a412-d73ce13c538b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:39 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8d1d69ae-cea3-4c9e-a412-d73ce13c538b Jul 19 17:42:39 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:39 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8d1d69ae-cea3-4c9e-a412-d73ce13c538b" returned: 0 in 0.472s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8d1d69ae-cea3-4c9e-a412-d73ce13c538b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:39 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8d1d69ae-cea3-4c9e-a412-d73ce13c538b Jul 19 17:42:39 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:40 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8d1d69ae-cea3-4c9e-a412-d73ce13c538b" returned: 0 in 0.369s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Lock "cinder-quobyte-8d1d69ae-cea3-4c9e-a412-d73ce13c538b" released by "delete_volume" :: held 0.908s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:40 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Created reservations ['efbad64d-d322-4ca5-8391-b1db8b17bfc4'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:40 devstack cinder-volume[87676]: WARNING cinder.quota [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1770764117 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1770764117, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:42:40 devstack cinder-volume[87676]: WARNING cinder.quota [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1770764117 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1770764117, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:42:40 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Created reservations ['20985ede-24b1-4720-b97e-ebf45707bb1d', '0d350df8-f308-40b7-b2d2-1399bbbb30bc', 'ed63a92b-231b-4931-8b19-b052b5f1e24b', '7fb35395-7126-4d8e-8f45-1fb4a62c669c'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:40 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Created reservations ['b9fc9d99-9bc8-407e-9bf4-f9fdaf0d2c36', '4925a557-64bb-4d3c-814c-8c4f3b049c0a', 'cd566a5c-08d0-4774-ba0f-01ab63ff9c62', '6acddefd-b425-4779-94cf-730d9465eef1'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:40 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:40 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:40 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:40 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:41 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.319s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:41 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:41 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a1824251-69ce-42d6-b82d-0b4b2f2c9625 tempest-GroupsTest-864039111 None] Delete group completed successfully. Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Flow 'volume_create_manager' (a80140c2-a6b9-484a-9c33-4f8c8c7f9559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d7c559-fdc5-4899-896d-45e3d2eca551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d7c559-fdc5-4899-896d-45e3d2eca551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1594842299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2681cf-670b-400a-8886-8948b19b3e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab5434b249845fe941da53daee2d005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:45Z,use_quota=True,user_id='e937acad9bc748a584e19be1f3b7b862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83681506-26a6-4a6a-98d4-92ec7c5af416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83681506-26a6-4a6a-98d4-92ec7c5af416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1e76e9-0670-41f0-8c4f-f1be8ba3eb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1e76e9-0670-41f0-8c4f-f1be8ba3eb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b2681cf-670b-400a-8886-8948b19b3e52', 'volume_name': 'volume-9b2681cf-670b-400a-8886-8948b19b3e52', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc8d905-dfad-4e26-b30b-f9d7dab45403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc8d905-dfad-4e26-b30b-f9d7dab45403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d305327e-8601-4d86-b179-9de282b70f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:44 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Volume 9b2681cf-670b-400a-8886-8948b19b3e52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b2681cf-670b-400a-8886-8948b19b3e52', 'volume_size': 1} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1594842299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2681cf-670b-400a-8886-8948b19b3e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab5434b249845fe941da53daee2d005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:45Z,use_quota=True,user_id='e937acad9bc748a584e19be1f3b7b862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Creating volume 9b2681cf-670b-400a-8886-8948b19b3e52 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:44 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:42:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9b2681cf-670b-400a-8886-8948b19b3e52 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:44 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9b2681cf-670b-400a-8886-8948b19b3e52 1073741824 Jul 19 17:42:44 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:45 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9b2681cf-670b-400a-8886-8948b19b3e52 1073741824" returned: 0 in 0.590s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9b2681cf-670b-400a-8886-8948b19b3e52 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:45 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9b2681cf-670b-400a-8886-8948b19b3e52 Jul 19 17:42:45 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:45 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9b2681cf-670b-400a-8886-8948b19b3e52" returned: 0 in 0.343s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d305327e-8601-4d86-b179-9de282b70f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b2681cf-670b-400a-8886-8948b19b3e52', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b086108c-544f-4d68-ae71-4d051359c5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:45 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Volume volume-9b2681cf-670b-400a-8886-8948b19b3e52 (9b2681cf-670b-400a-8886-8948b19b3e52): created successfully Jul 19 17:42:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b086108c-544f-4d68-ae71-4d051359c5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Flow 'volume_create_manager' (a80140c2-a6b9-484a-9c33-4f8c8c7f9559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:45 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f65d9e29-3635-4078-897f-eb8e7dec3363 tempest-VolumesMetadataTest-801017953 None] Created volume successfully. Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Flow 'volume_create_manager' (f0a9394b-3ea5-4023-9712-6940c1e62ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8471f0-6fc9-489e-b577-9a101782457d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8471f0-6fc9-489e-b577-9a101782457d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-209117836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920c8007-846c-468a-a45b-ffd87d162407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d10617aaa84dc0a406113190aba50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:46Z,use_quota=True,user_id='b506404c05f045cd9424c9015a2b5eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2f56fa-2cc4-4883-8d5c-dcfd888b1c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2f56fa-2cc4-4883-8d5c-dcfd888b1c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370b560c-54e1-43d7-be38-3c0d4e41112c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370b560c-54e1-43d7-be38-3c0d4e41112c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '920c8007-846c-468a-a45b-ffd87d162407', 'volume_name': 'volume-920c8007-846c-468a-a45b-ffd87d162407', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ce6793-82dd-4cea-8cf9-1d6a4b1e7343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ce6793-82dd-4cea-8cf9-1d6a4b1e7343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4053c0de-1804-4c5d-bd1f-4f583d33b12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:46 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Volume 920c8007-846c-468a-a45b-ffd87d162407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-920c8007-846c-468a-a45b-ffd87d162407', 'volume_size': 1} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-209117836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920c8007-846c-468a-a45b-ffd87d162407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d10617aaa84dc0a406113190aba50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:46Z,use_quota=True,user_id='b506404c05f045cd9424c9015a2b5eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Creating volume 920c8007-846c-468a-a45b-ffd87d162407 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:46 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:42:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:46 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407 1073741824 Jul 19 17:42:46 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:47 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407 1073741824" returned: 0 in 0.550s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:47 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407 Jul 19 17:42:47 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:47 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407" returned: 0 in 0.316s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4053c0de-1804-4c5d-bd1f-4f583d33b12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-920c8007-846c-468a-a45b-ffd87d162407', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9544dcf4-ea1f-41cd-a9f2-9eb631deafde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:47 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Volume volume-920c8007-846c-468a-a45b-ffd87d162407 (920c8007-846c-468a-a45b-ffd87d162407): created successfully Jul 19 17:42:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9544dcf4-ea1f-41cd-a9f2-9eb631deafde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Flow 'volume_create_manager' (f0a9394b-3ea5-4023-9712-6940c1e62ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:47 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-bc2ed0f9-5848-4bdf-bf45-57da871dca8d tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Created volume successfully. Jul 19 17:42:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Acquiring lock "cinder-9b2681cf-670b-400a-8886-8948b19b3e52-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Lock "cinder-9b2681cf-670b-400a-8886-8948b19b3e52-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Acquiring lock "cinder-quobyte-9b2681cf-670b-400a-8886-8948b19b3e52" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Lock "cinder-quobyte-9b2681cf-670b-400a-8886-8948b19b3e52" acquired by "delete_volume" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:47 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[47db617b-58d3-4f88-b397-0dc3d539b9bf]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9b2681cf-670b-400a-8886-8948b19b3e52 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:48 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9b2681cf-670b-400a-8886-8948b19b3e52 Jul 19 17:42:48 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:48 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9b2681cf-670b-400a-8886-8948b19b3e52" returned: 0 in 0.418s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9b2681cf-670b-400a-8886-8948b19b3e52 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:48 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9b2681cf-670b-400a-8886-8948b19b3e52 Jul 19 17:42:48 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:48 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9b2681cf-670b-400a-8886-8948b19b3e52" returned: 0 in 0.297s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:48 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Lock "cinder-quobyte-9b2681cf-670b-400a-8886-8948b19b3e52" released by "delete_volume" :: held 0.786s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:48 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Created reservations ['0d686dec-90b9-445e-a8e6-bccad5f16f4a', '6471320c-720e-4f62-980b-6323ad6505ac', '265b1f95-41cd-42a1-acc5-f370976a8c8f', '692a0572-ef43-4da6-ac41-f9beb0d2ed93'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:48 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:48 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Creating offline snapshot d67b904d-f436-4cd0-8e3a-fad9b586c895 of volume 920c8007-846c-468a-a45b-ffd87d162407 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:42:48 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c97acf6-e7ac-4b03-9b17-107bc61174e5]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:49 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407 Jul 19 17:42:49 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:49 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.437s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:49 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:49 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Deleted volume successfully. Jul 19 17:42:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-da40c6a0-2c67-44ea-ba80-00c751f15974 tempest-VolumesMetadataTest-801017953 None] Lock "cinder-9b2681cf-670b-400a-8886-8948b19b3e52-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:49 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407" returned: 0 in 0.791s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:49 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895 1G Jul 19 17:42:49 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:50 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895 1G" returned: 0 in 0.612s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920c8007-846c-468a-a45b-ffd87d162407 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:50 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920c8007-846c-468a-a45b-ffd87d162407 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895 Jul 19 17:42:50 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:50 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920c8007-846c-468a-a45b-ffd87d162407 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895" returned: 0 in 0.471s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:50 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895 is being set with open permissions: ugo+rw Jul 19 17:42:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:50 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895 Jul 19 17:42:50 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:51 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895" returned: 0 in 0.265s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:51 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.info Jul 19 17:42:51 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:51 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.info" returned: 0 in 0.383s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:51 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.info is being set with open permissions: ugo+rw Jul 19 17:42:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:51 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.info Jul 19 17:42:51 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:52 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.info" returned: 0 in 0.459s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.147s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:52 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-54f48e3a-6832-470d-a122-4eb147eafa3f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Create snapshot completed successfully Jul 19 17:42:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Acquiring lock "cinder-d67b904d-f436-4cd0-8e3a-fad9b586c895-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "cinder-d67b904d-f436-4cd0-8e3a-fad9b586c895-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Acquiring lock "cinder-quobyte-920c8007-846c-468a-a45b-ffd87d162407" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "cinder-quobyte-920c8007-846c-468a-a45b-ffd87d162407" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Acquiring lock "cinder-quobyte-d67b904d-f436-4cd0-8e3a-fad9b586c895" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "cinder-quobyte-d67b904d-f436-4cd0-8e3a-fad9b586c895" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Deleting offline snapshot d67b904d-f436-4cd0-8e3a-fad9b586c895 of volume 920c8007-846c-468a-a45b-ffd87d162407 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:42:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] snapshot_file for this snap is: volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:42:53 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8837101c-3070-4480-9c17-4302122a18eb]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:54 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895 Jul 19 17:42:54 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Flow 'volume_create_manager' (56a2f241-7795-4f26-acd5-ce885db62de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157813a2-b712-46ac-9974-594b64003905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:54 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895" returned: 0 in 0.602s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-920c8007-846c-468a-a45b-ffd87d162407(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157813a2-b712-46ac-9974-594b64003905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-455627287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4ea133-a3fb-4ec2-8bf7-ef292923a24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2926e8a616b409a912056095fc7ef3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:54Z,use_quota=True,user_id='92b881af6b0f4f85920a5530946f25a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b716b0-f7da-4e13-b590-656205e9e495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b716b0-f7da-4e13-b590-656205e9e495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f35f528-c86a-49d0-8012-062b872b5a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f35f528-c86a-49d0-8012-062b872b5a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb4ea133-a3fb-4ec2-8bf7-ef292923a24f', 'volume_name': 'volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a35e56-2299-41ae-9130-6cf3d1daf161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a35e56-2299-41ae-9130-6cf3d1daf161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e1b694-f617-4d5a-b58c-db7c96e9acfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:54 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Volume cb4ea133-a3fb-4ec2-8bf7-ef292923a24f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f', 'volume_size': 1} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-455627287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4ea133-a3fb-4ec2-8bf7-ef292923a24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2926e8a616b409a912056095fc7ef3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:54Z,use_quota=True,user_id='92b881af6b0f4f85920a5530946f25a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Creating volume cb4ea133-a3fb-4ec2-8bf7-ef292923a24f {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:54 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eedaaca-d2e4-43a7-8886-b804d6040389]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:54 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f 1073741824 Jul 19 17:42:54 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:54 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407 Jul 19 17:42:54 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:55 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407" returned: 0 in 0.436s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:55 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895 Jul 19 17:42:55 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:55 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f 1073741824" returned: 0 in 0.625s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:55 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f Jul 19 17:42:55 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Flow 'volume_create_manager' (e17f1337-4b59-46e6-99eb-d06e363b37c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5931c2d0-bb1f-4fab-8dee-1e85ad132872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5931c2d0-bb1f-4fab-8dee-1e85ad132872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-213527720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53509010-556d-40f5-9e67-a8c579c314c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a1143e363f41e68124528a54d2215e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:55Z,use_quota=True,user_id='c74b3983a6294add8a4f14209cd3f0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92296f45-049c-4e1c-8744-3a73a88e323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92296f45-049c-4e1c-8744-3a73a88e323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3333ee66-1885-495b-b623-a7aa993d7193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3333ee66-1885-495b-b623-a7aa993d7193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53509010-556d-40f5-9e67-a8c579c314c1', 'volume_name': 'volume-53509010-556d-40f5-9e67-a8c579c314c1', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a0eaa4-5751-4fe1-9c47-ccd15b98fef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a0eaa4-5751-4fe1-9c47-ccd15b98fef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d447b745-d001-48c0-84c6-72b2b480fa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:55 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Volume 53509010-556d-40f5-9e67-a8c579c314c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53509010-556d-40f5-9e67-a8c579c314c1', 'volume_size': 1} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:55 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895" returned: 0 in 0.496s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:55 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895 Jul 19 17:42:55 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:55 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" returned: 0 in 0.291s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.097s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-213527720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53509010-556d-40f5-9e67-a8c579c314c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a1143e363f41e68124528a54d2215e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:42:55Z,use_quota=True,user_id='c74b3983a6294add8a4f14209cd3f0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Creating volume 53509010-556d-40f5-9e67-a8c579c314c1 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:42:55 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-53509010-556d-40f5-9e67-a8c579c314c1 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:55 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-53509010-556d-40f5-9e67-a8c579c314c1 1073741824 Jul 19 17:42:55 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e1b694-f617-4d5a-b58c-db7c96e9acfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234c3265-73e1-4462-819f-4d44d9ed276b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:55 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Volume volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f (cb4ea133-a3fb-4ec2-8bf7-ef292923a24f): created successfully Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234c3265-73e1-4462-819f-4d44d9ed276b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Flow 'volume_create_manager' (56a2f241-7795-4f26-acd5-ce885db62de3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:55 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-48f4343f-a890-462d-adf1-bf7f26ccf753 tempest-VolumesActionsTest-597051494 None] Created volume successfully. Jul 19 17:42:55 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407.d67b904d-f436-4cd0-8e3a-fad9b586c895" returned: 0 in 0.277s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "cinder-quobyte-d67b904d-f436-4cd0-8e3a-fad9b586c895" released by "_delete_snapshot" :: held 2.027s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "cinder-quobyte-920c8007-846c-468a-a45b-ffd87d162407" released by "delete_snapshot" :: held 2.090s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:56 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Created reservations ['882496f7-a42b-427a-aae9-a133608ccbc1', '421d92fc-1d02-4f06-ba79-ae8f996d5137', '9b558b92-b723-468f-a3c5-5c0b68886d3f', 'b454301e-5b4b-49d9-96de-a5f8661c52c7'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:56 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Delete snapshot completed successfully. Jul 19 17:42:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ee82be24-95d1-4ab7-b895-919d42dc405f tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "cinder-d67b904d-f436-4cd0-8e3a-fad9b586c895-delete_snapshot" released by "delete_snapshot" :: held 2.242s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:56 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-53509010-556d-40f5-9e67-a8c579c314c1 1073741824" returned: 0 in 0.480s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-53509010-556d-40f5-9e67-a8c579c314c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:56 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-53509010-556d-40f5-9e67-a8c579c314c1 Jul 19 17:42:56 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:56 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-53509010-556d-40f5-9e67-a8c579c314c1" returned: 0 in 0.254s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:42:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d447b745-d001-48c0-84c6-72b2b480fa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53509010-556d-40f5-9e67-a8c579c314c1', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a30d7b-c42c-496d-a5de-6617df2e24af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:42:56 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Volume volume-53509010-556d-40f5-9e67-a8c579c314c1 (53509010-556d-40f5-9e67-a8c579c314c1): created successfully Jul 19 17:42:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a30d7b-c42c-496d-a5de-6617df2e24af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:42:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Flow 'volume_create_manager' (e17f1337-4b59-46e6-99eb-d06e363b37c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:42:56 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-5d91db13-c3d7-43f6-be39-ac609b4eb1ba tempest-VolumesTransfersV357Test-720046638 None] Created volume successfully. Jul 19 17:42:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Acquiring lock "cinder-920c8007-846c-468a-a45b-ffd87d162407-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "cinder-920c8007-846c-468a-a45b-ffd87d162407-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Acquiring lock "cinder-quobyte-920c8007-846c-468a-a45b-ffd87d162407" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "cinder-quobyte-920c8007-846c-468a-a45b-ffd87d162407" acquired by "delete_volume" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:57 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b15a88-274c-4069-9869-652d74364732]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:57 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407 Jul 19 17:42:57 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:57 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407" returned: 0 in 0.551s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:57 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407 Jul 19 17:42:57 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:58 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-920c8007-846c-468a-a45b-ffd87d162407" returned: 0 in 0.307s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:58 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "cinder-quobyte-920c8007-846c-468a-a45b-ffd87d162407" released by "delete_volume" :: held 0.949s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:58 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Created reservations ['4c87358d-f633-427c-ae52-687a01fad31f', '5af8ff9a-f5e7-4a1a-9f90-2e170d52af1a', 'd34d2f40-b797-4e33-a24f-3f2cb1ae061a', '40e8b299-c058-4297-8bd3-a5e61504b16f'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:42:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:42:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:42:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:42:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:42:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:42:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:58 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:42:58 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:42:58 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-56d2076a-3030-4f09-93b9-df14f8f39302 tempest-VolumesTransfersV357Test-1634641051 None] Transfer volume completed successfully. Jul 19 17:42:58 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Jul 19 17:42:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.353s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:42:58 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:42:58 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Deleted volume successfully. Jul 19 17:42:58 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-31f6157c-533c-4bc7-a453-25d62080e0bc tempest-VolumeSnapshotQuotasNegativeTestJSON-191859688 None] Lock "cinder-920c8007-846c-468a-a45b-ffd87d162407-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:42:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Acquiring lock "cinder-53509010-556d-40f5-9e67-a8c579c314c1-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Lock "cinder-53509010-556d-40f5-9e67-a8c579c314c1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Acquiring lock "cinder-quobyte-53509010-556d-40f5-9e67-a8c579c314c1" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:42:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Lock "cinder-quobyte-53509010-556d-40f5-9e67-a8c579c314c1" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:42:59 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[100aae2c-9433-4214-891b-5d8617d8ae1b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:42:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-53509010-556d-40f5-9e67-a8c579c314c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:42:59 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-53509010-556d-40f5-9e67-a8c579c314c1 Jul 19 17:42:59 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:00 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-53509010-556d-40f5-9e67-a8c579c314c1" returned: 0 in 0.750s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-53509010-556d-40f5-9e67-a8c579c314c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:00 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-53509010-556d-40f5-9e67-a8c579c314c1 Jul 19 17:43:00 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:00 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-53509010-556d-40f5-9e67-a8c579c314c1" returned: 0 in 0.383s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Lock "cinder-quobyte-53509010-556d-40f5-9e67-a8c579c314c1" released by "delete_volume" :: held 1.214s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:00 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Created reservations ['d4b09c01-817c-404f-ad14-a1da5e62b814', '356553ec-f9e5-4e54-b37d-464dd62c9139', '5e86b7db-7d27-4669-8527-6589997663bd', '13f2eef4-8681-4605-a71b-5da92418dad4'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:43:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:43:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:43:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:01 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:43:01 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:01 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.276s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:01 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:43:01 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Deleted volume successfully. Jul 19 17:43:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7e84ac8b-4d28-49a7-b533-4f70961a027d tempest-VolumesTransfersV357Test-1019858819 None] Lock "cinder-53509010-556d-40f5-9e67-a8c579c314c1-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Flow 'volume_create_manager' (707b2be7-7d20-4e87-b411-dd1ed8d3eaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62da08a-7ca4-4455-a49e-2566af7e78a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62da08a-7ca4-4455-a49e-2566af7e78a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-976622497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfcb7846-1856-424e-b857-8357b215b5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a1143e363f41e68124528a54d2215e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:43:03Z,use_quota=True,user_id='c74b3983a6294add8a4f14209cd3f0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8cdee5-f05c-427d-982e-be46748f3f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8cdee5-f05c-427d-982e-be46748f3f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981edb02-2794-4fa1-b3d4-6d6d0309161d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981edb02-2794-4fa1-b3d4-6d6d0309161d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfcb7846-1856-424e-b857-8357b215b5c1', 'volume_name': 'volume-dfcb7846-1856-424e-b857-8357b215b5c1', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2551c3ad-4c33-423b-8ee5-a5e527c4d53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2551c3ad-4c33-423b-8ee5-a5e527c4d53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03894fde-8a02-4482-a632-1612d9306e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:02 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Volume dfcb7846-1856-424e-b857-8357b215b5c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfcb7846-1856-424e-b857-8357b215b5c1', 'volume_size': 1} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-976622497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfcb7846-1856-424e-b857-8357b215b5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a1143e363f41e68124528a54d2215e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:43:03Z,use_quota=True,user_id='c74b3983a6294add8a4f14209cd3f0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Creating volume dfcb7846-1856-424e-b857-8357b215b5c1 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:43:02 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:43:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-dfcb7846-1856-424e-b857-8357b215b5c1 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:02 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-dfcb7846-1856-424e-b857-8357b215b5c1 1073741824 Jul 19 17:43:02 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:03 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-dfcb7846-1856-424e-b857-8357b215b5c1 1073741824" returned: 0 in 1.123s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-dfcb7846-1856-424e-b857-8357b215b5c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:04 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-dfcb7846-1856-424e-b857-8357b215b5c1 Jul 19 17:43:04 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:04 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-dfcb7846-1856-424e-b857-8357b215b5c1" returned: 0 in 0.516s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:43:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03894fde-8a02-4482-a632-1612d9306e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfcb7846-1856-424e-b857-8357b215b5c1', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96038d8-c775-42d3-8814-f2f31bff16a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:04 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Volume volume-dfcb7846-1856-424e-b857-8357b215b5c1 (dfcb7846-1856-424e-b857-8357b215b5c1): created successfully Jul 19 17:43:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96038d8-c775-42d3-8814-f2f31bff16a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Flow 'volume_create_manager' (707b2be7-7d20-4e87-b411-dd1ed8d3eaef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:43:04 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-26cc8f02-0129-400f-a027-27e282b5ec4d tempest-VolumesTransfersV357Test-720046638 None] Created volume successfully. Jul 19 17:43:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Acquiring lock "cinder-dfcb7846-1856-424e-b857-8357b215b5c1-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:43:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Lock "cinder-dfcb7846-1856-424e-b857-8357b215b5c1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:43:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Acquiring lock "cinder-quobyte-dfcb7846-1856-424e-b857-8357b215b5c1" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:43:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Lock "cinder-quobyte-dfcb7846-1856-424e-b857-8357b215b5c1" acquired by "delete_volume" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:43:06 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[154515de-025a-450e-9e3d-d59e95658065]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-dfcb7846-1856-424e-b857-8357b215b5c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:06 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-dfcb7846-1856-424e-b857-8357b215b5c1 Jul 19 17:43:06 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:06 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0f22d02d-2737-4525-a1d0-fe25e65493dc tempest-VolumesActionsTest-597051494 None] Acquiring lock "cinder-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" by "attach_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:43:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-dfcb7846-1856-424e-b857-8357b215b5c1" returned: 0 in 0.612s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-dfcb7846-1856-424e-b857-8357b215b5c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:06 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-dfcb7846-1856-424e-b857-8357b215b5c1 Jul 19 17:43:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0f22d02d-2737-4525-a1d0-fe25e65493dc tempest-VolumesActionsTest-597051494 None] Lock "cinder-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" acquired by "attach_volume" :: waited 0.063s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:43:06 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:07 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-0f22d02d-2737-4525-a1d0-fe25e65493dc tempest-VolumesActionsTest-597051494 None] Attaching volume cb4ea133-a3fb-4ec2-8bf7-ef292923a24f to instance 046292c3-95dc-45b1-b504-6f1e8635c103 at mountpoint /dev/vdb on host None. Jul 19 17:43:07 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-0f22d02d-2737-4525-a1d0-fe25e65493dc tempest-VolumesActionsTest-597051494 None] Attach volume completed successfully. Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0f22d02d-2737-4525-a1d0-fe25e65493dc tempest-VolumesActionsTest-597051494 None] Lock "cinder-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" released by "attach_volume" :: held 0.143s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9d467aeb-0c6c-4b49-8f1a-0a73c9dc55aa tempest-VolumesActionsTest-597051494 None] Acquiring lock "cinder-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f-detach_volume" by "detach_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9d467aeb-0c6c-4b49-8f1a-0a73c9dc55aa tempest-VolumesActionsTest-597051494 None] Lock "cinder-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:43:07 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9d467aeb-0c6c-4b49-8f1a-0a73c9dc55aa tempest-VolumesActionsTest-597051494 None] Detaching volume cb4ea133-a3fb-4ec2-8bf7-ef292923a24f from instance 046292c3-95dc-45b1-b504-6f1e8635c103. Jul 19 17:43:07 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9d467aeb-0c6c-4b49-8f1a-0a73c9dc55aa tempest-VolumesActionsTest-597051494 None] Detach volume completed successfully. Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9d467aeb-0c6c-4b49-8f1a-0a73c9dc55aa tempest-VolumesActionsTest-597051494 None] Lock "cinder-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f-detach_volume" released by "detach_volume" :: held 0.080s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:07 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-dfcb7846-1856-424e-b857-8357b215b5c1" returned: 0 in 0.558s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Lock "cinder-quobyte-dfcb7846-1856-424e-b857-8357b215b5c1" released by "delete_volume" :: held 1.261s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Created reservations ['91d8a932-8cef-488d-a1ed-76149f8e47ab', 'ee526ed2-5f0e-4f62-88d7-b56071a107c8', 'fa190329-132f-462a-ae9b-a7d40394a0b1', '89c2f709-b31a-40c0-8b61-082ecbd820e6'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:07 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:43:07 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Flow 'volume_create_manager' (60277acd-979c-471c-924e-e13f75cf2454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef59711-7515-4174-800f-66e6cab005e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef59711-7515-4174-800f-66e6cab005e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1286370628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ca7f84-7000-4185-8f59-caa0a74f04bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73dfcc8362ce4340aa7c520381281530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:43:08Z,use_quota=True,user_id='445bd7f6ac4545a9805690330508f8c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a70ce9b5-134c-4f67-9c00-26141a4f78a9),volume_type_id=a70ce9b5-134c-4f67-9c00-26141a4f78a9)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b81155-c046-4a90-8120-32663acc3b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b81155-c046-4a90-8120-32663acc3b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913eb494-8cbe-41ed-bb22-3b8545b4e099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913eb494-8cbe-41ed-bb22-3b8545b4e099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ca7f84-7000-4185-8f59-caa0a74f04bf', 'volume_name': 'volume-a3ca7f84-7000-4185-8f59-caa0a74f04bf', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc0bed3-bd5a-43e6-9e5c-820e5410b5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc0bed3-bd5a-43e6-9e5c-820e5410b5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e04747-5da9-403a-b730-cfb27ef12250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:08 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Volume a3ca7f84-7000-4185-8f59-caa0a74f04bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ca7f84-7000-4185-8f59-caa0a74f04bf', 'volume_size': 1} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1286370628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ca7f84-7000-4185-8f59-caa0a74f04bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73dfcc8362ce4340aa7c520381281530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:43:08Z,use_quota=True,user_id='445bd7f6ac4545a9805690330508f8c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a70ce9b5-134c-4f67-9c00-26141a4f78a9),volume_type_id=a70ce9b5-134c-4f67-9c00-26141a4f78a9)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Creating volume a3ca7f84-7000-4185-8f59-caa0a74f04bf {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:43:08 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3ca7f84-7000-4185-8f59-caa0a74f04bf 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:08 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3ca7f84-7000-4185-8f59-caa0a74f04bf 1073741824 Jul 19 17:43:08 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:08 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.419s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:43:08 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Deleted volume successfully. Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a1776d18-b3b3-48cf-b935-69f7905fc266 tempest-VolumesTransfersV357Test-1019858819 None] Lock "cinder-dfcb7846-1856-424e-b857-8357b215b5c1-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:08 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3ca7f84-7000-4185-8f59-caa0a74f04bf 1073741824" returned: 0 in 0.780s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=179,cinder:INSERT=56,cinder:UPDATE=219,cinder:DELETE=14 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:43:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3ca7f84-7000-4185-8f59-caa0a74f04bf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:08 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3ca7f84-7000-4185-8f59-caa0a74f04bf Jul 19 17:43:08 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:09 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3ca7f84-7000-4185-8f59-caa0a74f04bf" returned: 0 in 0.334s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:43:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e04747-5da9-403a-b730-cfb27ef12250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ca7f84-7000-4185-8f59-caa0a74f04bf', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea922802-57b6-4244-9e07-4794675b1663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:09 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=189,cinder:INSERT=58,cinder:UPDATE=249,cinder:DELETE=18 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:43:09 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Volume volume-a3ca7f84-7000-4185-8f59-caa0a74f04bf (a3ca7f84-7000-4185-8f59-caa0a74f04bf): created successfully Jul 19 17:43:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea922802-57b6-4244-9e07-4794675b1663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Flow 'volume_create_manager' (60277acd-979c-471c-924e-e13f75cf2454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:43:09 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-220c5c50-2c56-4aef-a28f-089d35d0e29e tempest-VolumeTypesAccessTest-982624842 None] Created volume successfully. Jul 19 17:43:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Acquiring lock "cinder-a3ca7f84-7000-4185-8f59-caa0a74f04bf-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:43:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Lock "cinder-a3ca7f84-7000-4185-8f59-caa0a74f04bf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:43:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Acquiring lock "cinder-quobyte-a3ca7f84-7000-4185-8f59-caa0a74f04bf" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:43:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Lock "cinder-quobyte-a3ca7f84-7000-4185-8f59-caa0a74f04bf" acquired by "delete_volume" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:43:10 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d59076-3694-43d8-aca5-c79eb42b23ca]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3ca7f84-7000-4185-8f59-caa0a74f04bf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:10 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3ca7f84-7000-4185-8f59-caa0a74f04bf Jul 19 17:43:10 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:10 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3ca7f84-7000-4185-8f59-caa0a74f04bf" returned: 0 in 0.483s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3ca7f84-7000-4185-8f59-caa0a74f04bf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:10 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3ca7f84-7000-4185-8f59-caa0a74f04bf Jul 19 17:43:10 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:11 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3ca7f84-7000-4185-8f59-caa0a74f04bf" returned: 0 in 0.354s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Lock "cinder-quobyte-a3ca7f84-7000-4185-8f59-caa0a74f04bf" released by "delete_volume" :: held 0.896s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:11 devstack cinder-volume[87676]: WARNING cinder.quota [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1218547770 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1218547770, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:43:11 devstack cinder-volume[87676]: WARNING cinder.quota [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1218547770 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1218547770, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:43:11 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Created reservations ['c7cdb1a4-ab7b-4ef8-acce-e63c516a5cdb', 'f48b76d1-6bfc-47a7-816e-f471ae530baa', 'fe1cfc8d-6497-44a7-9391-ee07d1b0464d', '63c13b14-e0f3-4ab5-9724-3c0715e4af4e'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:43:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:43:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:43:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:11 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:43:11 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:11 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.341s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:11 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:43:11 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Deleted volume successfully. Jul 19 17:43:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c2b9c3c4-8f4d-474a-ac87-98a22504da3b tempest-VolumeTypesAccessTest-982624842 None] Lock "cinder-a3ca7f84-7000-4185-8f59-caa0a74f04bf-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Flow 'volume_create_manager' (39460313-e57f-4e01-8e23-2020d566cd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b98726-90a6-40f6-b388-679b003c2963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b98726-90a6-40f6-b388-679b003c2963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-740069719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e23cc2-26da-4456-8a62-4191bb1d218f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50973b1859a54521b2d6e98838dea5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:43:18Z,use_quota=True,user_id='cb87211fcc3d4ebf99135c13bdd13cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194ca3c9-0857-456c-ae99-2bf7175752fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194ca3c9-0857-456c-ae99-2bf7175752fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0dd8813-6103-4b30-aa59-3e6c95af7bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0dd8813-6103-4b30-aa59-3e6c95af7bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5e23cc2-26da-4456-8a62-4191bb1d218f', 'volume_name': 'volume-b5e23cc2-26da-4456-8a62-4191bb1d218f', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223c478c-3f6e-4288-a11c-9f2f24680c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223c478c-3f6e-4288-a11c-9f2f24680c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a3105d-1520-40cb-bc0e-b8f28917e68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:17 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Volume b5e23cc2-26da-4456-8a62-4191bb1d218f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5e23cc2-26da-4456-8a62-4191bb1d218f', 'volume_size': 1} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-740069719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e23cc2-26da-4456-8a62-4191bb1d218f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50973b1859a54521b2d6e98838dea5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:43:18Z,use_quota=True,user_id='cb87211fcc3d4ebf99135c13bdd13cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Creating volume b5e23cc2-26da-4456-8a62-4191bb1d218f {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:43:17 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:43:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:18 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f 1073741824 Jul 19 17:43:18 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:18 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f 1073741824" returned: 0 in 0.631s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:18 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f Jul 19 17:43:18 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:19 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f" returned: 0 in 0.534s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:43:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a3105d-1520-40cb-bc0e-b8f28917e68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5e23cc2-26da-4456-8a62-4191bb1d218f', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6fb1c3-de6a-4605-8f0a-d12af7e13338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:19 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Volume volume-b5e23cc2-26da-4456-8a62-4191bb1d218f (b5e23cc2-26da-4456-8a62-4191bb1d218f): created successfully Jul 19 17:43:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6fb1c3-de6a-4605-8f0a-d12af7e13338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Flow 'volume_create_manager' (39460313-e57f-4e01-8e23-2020d566cd7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:43:19 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-53cd087c-dd81-429e-8d87-d6a749dfd90d tempest-VolumesCloneTest-1473143749 None] Created volume successfully. Jul 19 17:43:20 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Flow 'volume_create_manager' (f790d391-bda3-437d-b1d9-f00ce36328d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044cb3b5-0999-4988-894a-727e6a274128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044cb3b5-0999-4988-894a-727e6a274128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2009469068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6242e28f-7285-4db9-8fad-f50125f5f6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50973b1859a54521b2d6e98838dea5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:43:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b5e23cc2-26da-4456-8a62-4191bb1d218f,status='creating',terminated_at=None,updated_at=2026-07-19T15:43:21Z,use_quota=True,user_id='cb87211fcc3d4ebf99135c13bdd13cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d994ee81-8207-444f-8db4-04530c59ac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d994ee81-8207-444f-8db4-04530c59ac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84aa3440-ccd6-4511-a0d7-1646d960dd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84aa3440-ccd6-4511-a0d7-1646d960dd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6242e28f-7285-4db9-8fad-f50125f5f6e5', 'volume_name': 'volume-6242e28f-7285-4db9-8fad-f50125f5f6e5', 'volume_size': 2, 'source_volid': 'b5e23cc2-26da-4456-8a62-4191bb1d218f', 'source_volstatus': 'available'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6273f069-e42e-497d-9768-0388485de2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6273f069-e42e-497d-9768-0388485de2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e6244a-5c35-4992-8d77-afb7707f9819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:21 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Volume 6242e28f-7285-4db9-8fad-f50125f5f6e5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6242e28f-7285-4db9-8fad-f50125f5f6e5', 'volume_size': 2, 'source_volid': 'b5e23cc2-26da-4456-8a62-4191bb1d218f', 'source_volstatus': 'available'} Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:21 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Cloning volume b5e23cc2-26da-4456-8a62-4191bb1d218f to volume 6242e28f-7285-4db9-8fad-f50125f5f6e5 Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Creating offline snapshot e986f59b-26ae-4b96-9174-2de0befd439f of volume b5e23cc2-26da-4456-8a62-4191bb1d218f {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71f65f7-72c8-4da6-9b7e-cb636347df40]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:21 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f Jul 19 17:43:21 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:21 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f" returned: 0 in 0.494s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:21 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f 1G Jul 19 17:43:21 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:22 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f 1G" returned: 0 in 0.545s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e23cc2-26da-4456-8a62-4191bb1d218f -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:22 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e23cc2-26da-4456-8a62-4191bb1d218f -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f Jul 19 17:43:22 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:22 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e23cc2-26da-4456-8a62-4191bb1d218f -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f" returned: 0 in 0.576s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:22 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f is being set with open permissions: ugo+rw Jul 19 17:43:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:23 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f Jul 19 17:43:23 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a4be2964-3698-4a34-99ec-6a4ed4ee3e35 tempest-VolumesActionsTest-597051494 None] Acquiring lock "cinder-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" by "attach_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a4be2964-3698-4a34-99ec-6a4ed4ee3e35 tempest-VolumesActionsTest-597051494 None] Lock "cinder-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" acquired by "attach_volume" :: waited 0.048s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Flow 'volume_create_manager' (8f5fe73c-2e0a-4d8a-a25d-3ae5518bc33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f4ebb0-3217-400c-a4cc-e1c3a95aefd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f4ebb0-3217-400c-a4cc-e1c3a95aefd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-835759068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8536c152-bc92-4db7-9fc4-b15cb617f667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3673670119f64144b958581049898c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:43:23Z,use_quota=True,user_id='4500e6b0e89b433ebf04acdefea0814b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526d22a3-fac3-4b2a-a133-625405642b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526d22a3-fac3-4b2a-a133-625405642b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f1a73b-bb51-4ade-b188-e0a15e152567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG cinder.image.glance [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Creating Keystone auth plugin from conf {{(pid=87676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 17:43:23 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f" returned: 0 in 0.369s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a4be2964-3698-4a34-99ec-6a4ed4ee3e35 tempest-VolumesActionsTest-597051494 None] Attaching volume cb4ea133-a3fb-4ec2-8bf7-ef292923a24f to instance c199921f-20b6-4aed-b2c0-a8b118eaa75f at mountpoint /dev/vdb on host None. Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:23 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.info Jul 19 17:43:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a4be2964-3698-4a34-99ec-6a4ed4ee3e35 tempest-VolumesActionsTest-597051494 None] Attach volume completed successfully. Jul 19 17:43:23 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a4be2964-3698-4a34-99ec-6a4ed4ee3e35 tempest-VolumesActionsTest-597051494 None] Lock "cinder-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" released by "attach_volume" :: held 0.338s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-82531d3e-4483-43dd-86c2-38351ae4a296 tempest-VolumesActionsTest-597051494 None] Acquiring lock "cinder-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f-detach_volume" by "detach_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-82531d3e-4483-43dd-86c2-38351ae4a296 tempest-VolumesActionsTest-597051494 None] Lock "cinder-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:43:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-82531d3e-4483-43dd-86c2-38351ae4a296 tempest-VolumesActionsTest-597051494 None] Detaching volume cb4ea133-a3fb-4ec2-8bf7-ef292923a24f from instance c199921f-20b6-4aed-b2c0-a8b118eaa75f. Jul 19 17:43:23 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.info" returned: 0 in 0.477s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:23 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.info is being set with open permissions: ugo+rw Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:23 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.info Jul 19 17:43:23 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-82531d3e-4483-43dd-86c2-38351ae4a296 tempest-VolumesActionsTest-597051494 None] Detach volume completed successfully. Jul 19 17:43:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-82531d3e-4483-43dd-86c2-38351ae4a296 tempest-VolumesActionsTest-597051494 None] Lock "cinder-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f-detach_volume" released by "detach_volume" :: held 0.146s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:24 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.info" returned: 0 in 0.555s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Acquiring lock "cinder-quobyte-6242e28f-7285-4db9-8fad-f50125f5f6e5" by "_copy_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:43:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Lock "cinder-quobyte-6242e28f-7285-4db9-8fad-f50125f5f6e5" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:43:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] snapshot: e986f59b-26ae-4b96-9174-2de0befd439f, volume: 6242e28f-7285-4db9-8fad-f50125f5f6e5, {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 17:43:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:43:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:43:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:24 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac6109c-4dca-4dee-bc16-ec5396a378df]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:24 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f Jul 19 17:43:24 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f1a73b-bb51-4ade-b188-e0a15e152567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8536c152-bc92-4db7-9fc4-b15cb617f667', 'volume_name': 'volume-8536c152-bc92-4db7-9fc4-b15cb617f667', 'volume_size': 1, 'image_id': '3f690ae5-6466-476d-bb48-a634301656d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b6bd91692f74fd082fc706a6071a464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3f690ae5-6466-476d-bb48-a634301656d0', 'created_at': datetime.datetime(2026, 7, 19, 15, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 29, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f690ae5-6466-476d-bb48-a634301656d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1079a9-27fd-4c8b-8c46-b6354981bb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1079a9-27fd-4c8b-8c46-b6354981bb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83591b9f-7c01-4d8c-8d77-b3bc81b82233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:24 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Volume 8536c152-bc92-4db7-9fc4-b15cb617f667: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8536c152-bc92-4db7-9fc4-b15cb617f667', 'volume_size': 1, 'image_id': '3f690ae5-6466-476d-bb48-a634301656d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b6bd91692f74fd082fc706a6071a464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3f690ae5-6466-476d-bb48-a634301656d0', 'created_at': datetime.datetime(2026, 7, 19, 15, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 29, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f690ae5-6466-476d-bb48-a634301656d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 19 17:43:24 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Trying to clone 8536c152-bc92-4db7-9fc4-b15cb617f667 from image 3f690ae5-6466-476d-bb48-a634301656d0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}]). {{(pid=87676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 17:43:25 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f" returned: 0 in 0.576s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5e23cc2-26da-4456-8a62-4191bb1d218f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:43:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] will copy from snapshot at /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 17:43:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Creating direct copy from snapshot {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 17:43:25 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32e9a4e-fb4f-4abd-ab66-f340be57b4fb]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:25 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f Jul 19 17:43:25 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:25 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ufvwsnupdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 17:43:25 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Image download 20.69 MB at 20.69 MB/s Jul 19 17:43:25 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c60d9b8-ca45-4a3c-a0f1-2923a6d95472]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ufvwsnupdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:25 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f" returned: 0 in 0.515s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:25 devstack cinder-volume[87676]: DEBUG cinder.utils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Path /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6242e28f-7285-4db9-8fad-f50125f5f6e5 not found in is_blk_device check {{(pid=87676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 17:43:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6242e28f-7285-4db9-8fad-f50125f5f6e5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:25 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6242e28f-7285-4db9-8fad-f50125f5f6e5 Jul 19 17:43:25 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:25 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ufvwsnupdevstack@QuobyteHD Jul 19 17:43:25 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:26 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ufvwsnupdevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:26 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Temporary image 3f690ae5-6466-476d-bb48-a634301656d0 is fetched for user 4500e6b0e89b433ebf04acdefea0814b. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 17:43:26 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2929adf7-d997-400f-a0cc-f98a54731d15]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ufvwsnupdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:26 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ufvwsnupdevstack@QuobyteHD Jul 19 17:43:26 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:27 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ufvwsnupdevstack@QuobyteHD" returned: 0 in 0.820s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:31 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6242e28f-7285-4db9-8fad-f50125f5f6e5" returned: 0 in 5.600s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:31 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f81a26-7915-452f-a670-2220cf3a5251]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:31 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f Jul 19 17:43:31 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-afbed585-01d4-4248-824b-69bf9570a640 tempest-VolumesActionsTest-597051494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:31 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f" returned: 0 in 0.504s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:31 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Image conversion details: src /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6242e28f-7285-4db9-8fad-f50125f5f6e5 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:43:31 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Converted 1024.00 MB image at 182.80 MB/s Jul 19 17:43:31 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6242e28f-7285-4db9-8fad-f50125f5f6e5 is being set with open permissions: ugo+rw Jul 19 17:43:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6242e28f-7285-4db9-8fad-f50125f5f6e5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:31 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6242e28f-7285-4db9-8fad-f50125f5f6e5 Jul 19 17:43:31 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:32 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6242e28f-7285-4db9-8fad-f50125f5f6e5" returned: 0 in 0.255s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Lock "cinder-quobyte-6242e28f-7285-4db9-8fad-f50125f5f6e5" released by "_copy_volume_from_snapshot" :: held 7.646s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Acquiring lock "cinder-quobyte-e986f59b-26ae-4b96-9174-2de0befd439f" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Lock "cinder-quobyte-e986f59b-26ae-4b96-9174-2de0befd439f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Deleting offline snapshot e986f59b-26ae-4b96-9174-2de0befd439f of volume b5e23cc2-26da-4456-8a62-4191bb1d218f {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] snapshot_file for this snap is: volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1908ad-238a-47c1-b396-08f8ae3bdcfe]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:32 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f Jul 19 17:43:32 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Flow 'volume_create_manager' (e41025df-6e03-4dec-9a77-3a5f1daba591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca11e5f-6549-48e7-9586-aa0d9d3caa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca11e5f-6549-48e7-9586-aa0d9d3caa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-317242927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4a263f-9826-47f6-8bec-71ad35dd7a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3e5e1f56bd46e399c01ff0f4c78dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:43:32Z,use_quota=True,user_id='d415bc6174b64d00bb7489974aaf1d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef93669b-6988-4a72-a270-858f8c2931d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef93669b-6988-4a72-a270-858f8c2931d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c5ee4e-a483-4b0b-88dc-aca212d6fa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c5ee4e-a483-4b0b-88dc-aca212d6fa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c4a263f-9826-47f6-8bec-71ad35dd7a43', 'volume_name': 'volume-3c4a263f-9826-47f6-8bec-71ad35dd7a43', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a89e63-8104-4560-a087-a4d1174b9636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a89e63-8104-4560-a087-a4d1174b9636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee16dfa4-e6bf-4607-bc99-3cf1839f6fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:32 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Volume 3c4a263f-9826-47f6-8bec-71ad35dd7a43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c4a263f-9826-47f6-8bec-71ad35dd7a43', 'volume_size': 1} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:32 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f" returned: 0 in 0.362s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5e23cc2-26da-4456-8a62-4191bb1d218f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4b655f-bc20-4817-acbc-e935e3540927]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:32 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f Jul 19 17:43:32 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:32 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f" returned: 0 in 0.351s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:32 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f Jul 19 17:43:32 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:33 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f" returned: 0 in 0.341s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:33 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f Jul 19 17:43:33 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:33 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f.e986f59b-26ae-4b96-9174-2de0befd439f" returned: 0 in 0.262s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Lock "cinder-quobyte-e986f59b-26ae-4b96-9174-2de0befd439f" released by "_delete_snapshot" :: held 1.412s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.354s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.475s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-835759068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8536c152-bc92-4db7-9fc4-b15cb617f667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3673670119f64144b958581049898c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:43:23Z,use_quota=True,user_id='4500e6b0e89b433ebf04acdefea0814b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Creating volume 8536c152-bc92-4db7-9fc4-b15cb617f667 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:43:33 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e6244a-5c35-4992-8d77-afb7707f9819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6242e28f-7285-4db9-8fad-f50125f5f6e5', 'volume_size': 2, 'source_volid': 'b5e23cc2-26da-4456-8a62-4191bb1d218f', 'source_volstatus': 'available'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:33 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667 1073741824 Jul 19 17:43:33 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d215488a-4ea5-4756-b092-1b0dc85ea99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:33 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Volume volume-6242e28f-7285-4db9-8fad-f50125f5f6e5 (6242e28f-7285-4db9-8fad-f50125f5f6e5): created successfully Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d215488a-4ea5-4756-b092-1b0dc85ea99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Flow 'volume_create_manager' (f790d391-bda3-437d-b1d9-f00ce36328d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:43:33 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ae931fb4-1604-4be1-b36c-fd30757e7e1b tempest-VolumesCloneTest-1473143749 None] Created volume successfully. Jul 19 17:43:33 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667 1073741824" returned: 0 in 0.412s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:34 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667 Jul 19 17:43:34 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:34 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667" returned: 0 in 0.258s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-afbed585-01d4-4248-824b-69bf9570a640 tempest-VolumesActionsTest-597051494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.564s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Attempting download of 3f690ae5-6466-476d-bb48-a634301656d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}])) to volume 8536c152-bc92-4db7-9fc4-b15cb617f667. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b58771-11ec-4dd3-8cab-22971d280910]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-afbed585-01d4-4248-824b-69bf9570a640 tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Acquiring lock "cinder-6242e28f-7285-4db9-8fad-f50125f5f6e5-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Lock "cinder-6242e28f-7285-4db9-8fad-f50125f5f6e5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c784141-a182-4dd1-82e2-7e5be40a6841]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_jffc8tl8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Acquiring lock "cinder-quobyte-6242e28f-7285-4db9-8fad-f50125f5f6e5" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Lock "cinder-quobyte-6242e28f-7285-4db9-8fad-f50125f5f6e5" acquired by "delete_volume" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54517a8-0376-4cbb-b9dc-b2b5fbbeab72]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6242e28f-7285-4db9-8fad-f50125f5f6e5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:34 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f Jul 19 17:43:34 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:34 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_jffc8tl8 Jul 19 17:43:34 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:34 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6242e28f-7285-4db9-8fad-f50125f5f6e5 Jul 19 17:43:34 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:34 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_jffc8tl8" returned: 0 in 0.373s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_jffc8tl8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:34 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-afbed585-01d4-4248-824b-69bf9570a640 tempest-VolumesActionsTest-597051494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" returned: 0 in 0.462s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[786e6e5d-591e-47da-b5ff-a7335ed7b678]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-afbed585-01d4-4248-824b-69bf9570a640 tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:34 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6242e28f-7285-4db9-8fad-f50125f5f6e5" returned: 0 in 0.395s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6242e28f-7285-4db9-8fad-f50125f5f6e5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:34 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_jffc8tl8 Jul 19 17:43:34 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:34 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6242e28f-7285-4db9-8fad-f50125f5f6e5 Jul 19 17:43:34 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:34 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f Jul 19 17:43:34 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:35 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:43:35 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:35 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_jffc8tl8" returned: 1 in 0.338s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_jffc8tl8' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece781b3-36c1-4c0f-b93a-917b7f84f11a]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ufvwsnupdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:35 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6242e28f-7285-4db9-8fad-f50125f5f6e5" returned: 0 in 0.279s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Lock "cinder-quobyte-6242e28f-7285-4db9-8fad-f50125f5f6e5" released by "delete_volume" :: held 0.727s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:35 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-afbed585-01d4-4248-824b-69bf9570a640 tempest-VolumesActionsTest-597051494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" returned: 0 in 0.382s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-afbed585-01d4-4248-824b-69bf9570a640 tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.884de9fa-89d0-4d88-9331-0d37f70184cccgi97f3q.img {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:35 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.260s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:43:35 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.884de9fa-89d0-4d88-9331-0d37f70184cccgi97f3q.img Jul 19 17:43:35 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:35 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ufvwsnupdevstack@QuobyteHD Jul 19 17:43:35 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 28 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Created reservations ['c1b1d80f-39aa-463c-9622-8d17756c7b8c', 'cbcaa2e1-2d99-4390-873f-1c13aa129837', '5057dba1-5ce8-4ab9-aa46-a6943e326074', 'd4af1e30-5795-4815-804d-7b3924d1be8b'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:35 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:43:35 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:35 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ufvwsnupdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] 3f690ae5-6466-476d-bb48-a634301656d0 was qcow2, converting to qcow2 {{(pid=87676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ufvwsnupdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:35 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ufvwsnupdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667 Jul 19 17:43:35 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:35 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.391s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:43:35 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Deleted volume successfully. Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-db27a285-2389-4a30-bfac-bb2ce00e1fe1 tempest-VolumesCloneTest-1473143749 None] Lock "cinder-6242e28f-7285-4db9-8fad-f50125f5f6e5-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Acquiring lock "cinder-b5e23cc2-26da-4456-8a62-4191bb1d218f-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Lock "cinder-b5e23cc2-26da-4456-8a62-4191bb1d218f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:43:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Acquiring lock "cinder-quobyte-b5e23cc2-26da-4456-8a62-4191bb1d218f" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:43:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Lock "cinder-quobyte-b5e23cc2-26da-4456-8a62-4191bb1d218f" acquired by "delete_volume" :: waited 0.034s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:43:36 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d41869-c772-4d0b-8b02-0991ae0e111e]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:36 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f Jul 19 17:43:36 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:36 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f" returned: 0 in 0.869s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:37 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f Jul 19 17:43:37 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:37 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5e23cc2-26da-4456-8a62-4191bb1d218f" returned: 0 in 0.470s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Lock "cinder-quobyte-b5e23cc2-26da-4456-8a62-4191bb1d218f" released by "delete_volume" :: held 1.480s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:37 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Created reservations ['6cd046d9-cf0e-416e-a941-2751c25f9785', '6357fa66-09c1-46c5-ac00-7bc159e7ef87', '62ab2047-977e-49e9-a243-120d2f9f2a41', '5d0d2e26-1dd5-4611-9735-b934e0546ded'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:43:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:43:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:43:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:37 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:43:37 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:38 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.485s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:38 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:43:38 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Deleted volume successfully. Jul 19 17:43:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b99d7d16-54fa-4027-8ad9-36b59c6ee500 tempest-VolumesCloneTest-1473143749 None] Lock "cinder-b5e23cc2-26da-4456-8a62-4191bb1d218f-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:39 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ufvwsnupdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667" returned: 0 in 4.185s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:39 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ufvwsnupdevstack@QuobyteHD, size 112.00 MB, duration 4.19 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:43:39 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Converted 112.00 MB image at 26.73 MB/s Jul 19 17:43:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:39 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667 1G Jul 19 17:43:39 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:40 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667 1G" returned: 0 in 0.864s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:40 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Downloaded image 3f690ae5-6466-476d-bb48-a634301656d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}])) to volume 8536c152-bc92-4db7-9fc4-b15cb617f667 successfully. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 17:43:40 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Temporary image 3f690ae5-6466-476d-bb48-a634301656d0 for user 4500e6b0e89b433ebf04acdefea0814b is deleted. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 17:43:40 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Marking volume 8536c152-bc92-4db7-9fc4-b15cb617f667 as bootable. {{(pid=87676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 17:43:40 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-afbed585-01d4-4248-824b-69bf9570a640 tempest-VolumesActionsTest-597051494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.884de9fa-89d0-4d88-9331-0d37f70184cccgi97f3q.img" returned: 0 in 5.416s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:40 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Copying metadata from image 3f690ae5-6466-476d-bb48-a634301656d0 to 8536c152-bc92-4db7-9fc4-b15cb617f667. {{(pid=87676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 17:43:40 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Creating volume glance metadata for volume 8536c152-bc92-4db7-9fc4-b15cb617f667 backed by image 3f690ae5-6466-476d-bb48-a634301656d0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3f690ae5-6466-476d-bb48-a634301656d0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 17:43:40 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[43674909-ef6c-47e8-b4ed-1d65a3e56142]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-afbed585-01d4-4248-824b-69bf9570a640 tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83591b9f-7c01-4d8c-8d77-b3bc81b82233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8536c152-bc92-4db7-9fc4-b15cb617f667', 'volume_size': 1, 'image_id': '3f690ae5-6466-476d-bb48-a634301656d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b6bd91692f74fd082fc706a6071a464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3f690ae5-6466-476d-bb48-a634301656d0', 'created_at': datetime.datetime(2026, 7, 19, 15, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 29, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f690ae5-6466-476d-bb48-a634301656d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3a041d-7968-4992-baca-9bd3a65ca679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:40 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Volume volume-8536c152-bc92-4db7-9fc4-b15cb617f667 (8536c152-bc92-4db7-9fc4-b15cb617f667): created successfully Jul 19 17:43:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3a041d-7968-4992-baca-9bd3a65ca679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:40 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f Jul 19 17:43:40 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Flow 'volume_create_manager' (8f5fe73c-2e0a-4d8a-a25d-3ae5518bc33a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:43:40 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-20318453-1a6c-4410-95d5-07ad2c3ed89d tempest-VolumesImageMetadata-1201394623 None] Created volume successfully. Jul 19 17:43:41 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-afbed585-01d4-4248-824b-69bf9570a640 tempest-VolumesActionsTest-597051494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" returned: 0 in 0.548s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:41 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-afbed585-01d4-4248-824b-69bf9570a640 tempest-VolumesActionsTest-597051494 None] Image conversion details: src /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.884de9fa-89d0-4d88-9331-0d37f70184cccgi97f3q.img {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:43:41 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-afbed585-01d4-4248-824b-69bf9570a640 tempest-VolumesActionsTest-597051494 None] Converted 1024.00 MB image at 188.98 MB/s Jul 19 17:43:41 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-afbed585-01d4-4248-824b-69bf9570a640 tempest-VolumesActionsTest-597051494 None] 884de9fa-89d0-4d88-9331-0d37f70184cc was raw, no need to convert to raw {{(pid=87676) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 19 17:43:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Acquiring lock "cinder-8536c152-bc92-4db7-9fc4-b15cb617f667-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:43:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Lock "cinder-8536c152-bc92-4db7-9fc4-b15cb617f667-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:43:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Acquiring lock "cinder-quobyte-8536c152-bc92-4db7-9fc4-b15cb617f667" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:43:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Lock "cinder-quobyte-8536c152-bc92-4db7-9fc4-b15cb617f667" acquired by "delete_volume" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:43:41 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d92eed-e303-4844-bae9-a9b9d668ed2a]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:43:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:41 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667 Jul 19 17:43:41 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:42 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667" returned: 0 in 0.383s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:42 devstack sudo[97416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667 Jul 19 17:43:42 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:42 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8536c152-bc92-4db7-9fc4-b15cb617f667" returned: 0 in 0.285s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Lock "cinder-quobyte-8536c152-bc92-4db7-9fc4-b15cb617f667" released by "delete_volume" :: held 0.732s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Created reservations ['f7c82549-1072-42ef-b014-77e623f1031c', '74a87c85-9d2a-4392-a264-a48212242c2e', 'f67500ff-8167-4214-94df-f40408d0afeb', 'd1ec3921-ea6d-4414-8c79-a5c9c0217b72'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:43:42 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:43:42 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Flow 'volume_create_manager' (3984cc97-d3f6-4d00-9b3e-63d2ca36d6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121f9ccc-a634-4520-8d44-c0e82304990a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121f9ccc-a634-4520-8d44-c0e82304990a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-32684410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5b7461-ffd9-4047-afb5-e6222d1ad712,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25f4b2830e748d5a11351c557d62fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:43:43Z,use_quota=True,user_id='a8eafb61039043f18d4ddc76e4990c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e75693-c938-4268-a299-664e6cc813f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e75693-c938-4268-a299-664e6cc813f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a0cfbd-4830-4eb3-871d-295b3265d24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a0cfbd-4830-4eb3-871d-295b3265d24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf5b7461-ffd9-4047-afb5-e6222d1ad712', 'volume_name': 'volume-cf5b7461-ffd9-4047-afb5-e6222d1ad712', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5324f702-be5d-44c0-a344-608948700912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5324f702-be5d-44c0-a344-608948700912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6f0ca8-f8c3-4325-82de-7ae6b88597a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:42 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Volume cf5b7461-ffd9-4047-afb5-e6222d1ad712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf5b7461-ffd9-4047-afb5-e6222d1ad712', 'volume_size': 1} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:42 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.318s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:43:42 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Deleted volume successfully. Jul 19 17:43:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-84c6eb67-b1b4-45a1-8ace-4eaf5b44836a tempest-VolumesImageMetadata-1201394623 None] Lock "cinder-8536c152-bc92-4db7-9fc4-b15cb617f667-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:43:47 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:43:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Flow 'volume_create_manager' (a7793c66-29a6-43d0-873c-696a879fc091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:43:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4cabf48-cb11-4349-a3f5-b64f703f106f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4cabf48-cb11-4349-a3f5-b64f703f106f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1081352494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90cbeccf-8fb5-4134-9143-edac9ac7b057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806584263df84d4b802686645e3c4d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:43:47Z,use_quota=True,user_id='81c9a6f5a40643fa9e231cd31d171b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c07da8-2599-4c13-9cc0-44e0ba8bd2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c07da8-2599-4c13-9cc0-44e0ba8bd2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd2b7dc-4927-43dd-a74a-a787b1e70e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd2b7dc-4927-43dd-a74a-a787b1e70e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90cbeccf-8fb5-4134-9143-edac9ac7b057', 'volume_name': 'volume-90cbeccf-8fb5-4134-9143-edac9ac7b057', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b68d001-8169-46f6-b17f-c7046c6142c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b68d001-8169-46f6-b17f-c7046c6142c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:43:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8af3473-709d-4702-b5f1-591730867067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:43:47 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Volume 90cbeccf-8fb5-4134-9143-edac9ac7b057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90cbeccf-8fb5-4134-9143-edac9ac7b057', 'volume_size': 1} Jul 19 17:43:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:43:57 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:UPDATE=49,cinder:DELETE=5,cinder:SELECT=49,cinder:INSERT=20 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:43:57 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=46,cinder:UPDATE=50,cinder:INSERT=16,cinder:DELETE=3 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:44:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-afbed585-01d4-4248-824b-69bf9570a640 tempest-VolumesActionsTest-597051494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.221s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-afbed585-01d4-4248-824b-69bf9570a640 tempest-VolumesActionsTest-597051494 None] Uploaded volume to glance image-id: 884de9fa-89d0-4d88-9331-0d37f70184cc. {{(pid=87676) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 19 17:44:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.040s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-317242927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4a263f-9826-47f6-8bec-71ad35dd7a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3e5e1f56bd46e399c01ff0f4c78dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:43:32Z,use_quota=True,user_id='d415bc6174b64d00bb7489974aaf1d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Creating volume 3c4a263f-9826-47f6-8bec-71ad35dd7a43 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:00 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3c4a263f-9826-47f6-8bec-71ad35dd7a43 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:00 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3c4a263f-9826-47f6-8bec-71ad35dd7a43 1073741824 Jul 19 17:44:00 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:00 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-afbed585-01d4-4248-824b-69bf9570a640 tempest-VolumesActionsTest-597051494 None] Copy volume to image completed successfully. Jul 19 17:44:00 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3c4a263f-9826-47f6-8bec-71ad35dd7a43 1073741824" returned: 0 in 0.416s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3c4a263f-9826-47f6-8bec-71ad35dd7a43 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:01 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3c4a263f-9826-47f6-8bec-71ad35dd7a43 Jul 19 17:44:01 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:01 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3c4a263f-9826-47f6-8bec-71ad35dd7a43" returned: 0 in 0.264s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.429s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-32684410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5b7461-ffd9-4047-afb5-e6222d1ad712,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25f4b2830e748d5a11351c557d62fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:43:43Z,use_quota=True,user_id='a8eafb61039043f18d4ddc76e4990c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Creating volume cf5b7461-ffd9-4047-afb5-e6222d1ad712 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:01 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cf5b7461-ffd9-4047-afb5-e6222d1ad712 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:01 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cf5b7461-ffd9-4047-afb5-e6222d1ad712 1073741824 Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee16dfa4-e6bf-4607-bc99-3cf1839f6fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c4a263f-9826-47f6-8bec-71ad35dd7a43', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:01 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb61e44-e5d6-481d-8f62-fea3d6f28b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:01 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Volume volume-3c4a263f-9826-47f6-8bec-71ad35dd7a43 (3c4a263f-9826-47f6-8bec-71ad35dd7a43): created successfully Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb61e44-e5d6-481d-8f62-fea3d6f28b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Flow 'volume_create_manager' (e41025df-6e03-4dec-9a77-3a5f1daba591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:01 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-6c829848-1819-4d47-9303-af362be79d39 tempest-VolumesListAdminTestJSON-85698748 None] Created volume successfully. Jul 19 17:44:01 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cf5b7461-ffd9-4047-afb5-e6222d1ad712 1073741824" returned: 0 in 0.523s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cf5b7461-ffd9-4047-afb5-e6222d1ad712 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:01 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cf5b7461-ffd9-4047-afb5-e6222d1ad712 Jul 19 17:44:01 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Flow 'volume_create_manager' (9e0bd70f-eb25-49ef-bb2b-588b9ccd5fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc073a22-9ee4-4544-afc5-512fd75d873c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc073a22-9ee4-4544-afc5-512fd75d873c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-959797793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=050fd547-2711-4836-8bc8-bc307f422eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3e5e1f56bd46e399c01ff0f4c78dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:02Z,use_quota=True,user_id='d415bc6174b64d00bb7489974aaf1d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0cfb88b-f954-40d0-b258-709d33dd3e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0cfb88b-f954-40d0-b258-709d33dd3e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b29af84-964b-4f8e-b692-a637c4ce5d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b29af84-964b-4f8e-b692-a637c4ce5d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '050fd547-2711-4836-8bc8-bc307f422eaa', 'volume_name': 'volume-050fd547-2711-4836-8bc8-bc307f422eaa', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33eaea98-9c24-4cca-8d6e-83386e08d47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33eaea98-9c24-4cca-8d6e-83386e08d47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db924df-b6c2-48ab-9e41-cf933a1684f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:02 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Volume 050fd547-2711-4836-8bc8-bc307f422eaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-050fd547-2711-4836-8bc8-bc307f422eaa', 'volume_size': 1} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:02 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cf5b7461-ffd9-4047-afb5-e6222d1ad712" returned: 0 in 0.262s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.602s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1081352494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90cbeccf-8fb5-4134-9143-edac9ac7b057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806584263df84d4b802686645e3c4d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:43:47Z,use_quota=True,user_id='81c9a6f5a40643fa9e231cd31d171b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Creating volume 90cbeccf-8fb5-4134-9143-edac9ac7b057 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:02 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-90cbeccf-8fb5-4134-9143-edac9ac7b057 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6f0ca8-f8c3-4325-82de-7ae6b88597a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf5b7461-ffd9-4047-afb5-e6222d1ad712', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:02 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-90cbeccf-8fb5-4134-9143-edac9ac7b057 1073741824 Jul 19 17:44:02 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a94cad2-4e7c-462c-ae4b-79b135dac7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:02 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Volume volume-cf5b7461-ffd9-4047-afb5-e6222d1ad712 (cf5b7461-ffd9-4047-afb5-e6222d1ad712): created successfully Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a94cad2-4e7c-462c-ae4b-79b135dac7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Flow 'volume_create_manager' (3984cc97-d3f6-4d00-9b3e-63d2ca36d6c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:02 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-77cd0505-8fdb-4e9c-99d4-c770be1d6260 tempest-VolumesListTestJSON-2077666899 None] Created volume successfully. Jul 19 17:44:02 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-90cbeccf-8fb5-4134-9143-edac9ac7b057 1073741824" returned: 0 in 0.408s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-90cbeccf-8fb5-4134-9143-edac9ac7b057 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:02 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-90cbeccf-8fb5-4134-9143-edac9ac7b057 Jul 19 17:44:02 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:02 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-90cbeccf-8fb5-4134-9143-edac9ac7b057" returned: 0 in 0.246s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.980s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8af3473-709d-4702-b5f1-591730867067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90cbeccf-8fb5-4134-9143-edac9ac7b057', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c38e7e-66ff-4a0c-9708-800cf7c45d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34ca736-864c-442a-9f4a-debcc0bc71d0]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:02 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Volume volume-90cbeccf-8fb5-4134-9143-edac9ac7b057 (90cbeccf-8fb5-4134-9143-edac9ac7b057): created successfully Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c38e7e-66ff-4a0c-9708-800cf7c45d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Flow 'volume_create_manager' (a7793c66-29a6-43d0-873c-696a879fc091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:02 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ce66b4c0-cdb1-4e94-baae-0b1b4e3123df tempest-VolumesTransfersTest-792087820 None] Created volume successfully. Jul 19 17:44:02 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f Jul 19 17:44:02 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:03 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" returned: 0 in 0.383s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4023ba9d-4017-4767-9ff9-c4657c8d7d1a]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:03 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f Jul 19 17:44:03 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Flow 'volume_create_manager' (9b094e8e-7cf5-4316-9e5d-64a6f1795cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86960d84-046e-489d-9373-2faf03d25dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86960d84-046e-489d-9373-2faf03d25dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-881896655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e9634c-5f7f-4a66-bede-687d8baee46d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25f4b2830e748d5a11351c557d62fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:04Z,use_quota=True,user_id='a8eafb61039043f18d4ddc76e4990c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1956862-f1ac-493b-b2e7-8efbf4ceb677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1956862-f1ac-493b-b2e7-8efbf4ceb677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700ea3a0-9fe8-4276-8ebc-9d1495d8155b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700ea3a0-9fe8-4276-8ebc-9d1495d8155b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e9634c-5f7f-4a66-bede-687d8baee46d', 'volume_name': 'volume-61e9634c-5f7f-4a66-bede-687d8baee46d', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c89d17-7ffa-4ed2-9b87-7f99330be1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c89d17-7ffa-4ed2-9b87-7f99330be1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c17579-869b-427b-9c85-693bb89725bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:03 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Volume 61e9634c-5f7f-4a66-bede-687d8baee46d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e9634c-5f7f-4a66-bede-687d8baee46d', 'volume_size': 1} Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:03 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" returned: 0 in 0.447s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.3461c031-22d0-41a4-a9c2-2be0b560ce66s904067l.img {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:03 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.3461c031-22d0-41a4-a9c2-2be0b560ce66s904067l.img Jul 19 17:44:03 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:04 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-e796bc19-32db-4ab6-b920-51aa9da2094a tempest-VolumesTransfersTest-647451464 None] Transfer volume completed successfully. Jul 19 17:44:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Acquiring lock "cinder-90cbeccf-8fb5-4134-9143-edac9ac7b057-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Lock "cinder-90cbeccf-8fb5-4134-9143-edac9ac7b057-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Acquiring lock "cinder-quobyte-90cbeccf-8fb5-4134-9143-edac9ac7b057" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Lock "cinder-quobyte-90cbeccf-8fb5-4134-9143-edac9ac7b057" acquired by "delete_volume" :: waited 0.035s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:05 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8166be93-f2b0-4c7b-b320-2eff6edb7fa2]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-90cbeccf-8fb5-4134-9143-edac9ac7b057 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:05 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-90cbeccf-8fb5-4134-9143-edac9ac7b057 Jul 19 17:44:05 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:06 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-90cbeccf-8fb5-4134-9143-edac9ac7b057" returned: 0 in 1.017s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-90cbeccf-8fb5-4134-9143-edac9ac7b057 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:06 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-90cbeccf-8fb5-4134-9143-edac9ac7b057 Jul 19 17:44:06 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:06 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-90cbeccf-8fb5-4134-9143-edac9ac7b057" returned: 0 in 0.539s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Lock "cinder-quobyte-90cbeccf-8fb5-4134-9143-edac9ac7b057" released by "delete_volume" :: held 1.647s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:07 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Created reservations ['60dadcdb-966e-4e3a-ad36-de59b25f1b71', 'eb67e5e1-457a-482c-a2ea-6c0858557a6c', 'c11d3ce3-4088-41f7-9d9d-4845109cb08f', 'a9cc736b-507b-4a07-b2c3-a463380899b1'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:07 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:07 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:07 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.386s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:07 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:07 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Deleted volume successfully. Jul 19 17:44:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-913174a0-5ccd-4177-a96a-fbc1b44491a1 tempest-VolumesTransfersTest-372594058 None] Lock "cinder-90cbeccf-8fb5-4134-9143-edac9ac7b057-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:08 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.3461c031-22d0-41a4-a9c2-2be0b560ce66s904067l.img" returned: 0 in 4.619s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c0617b-dc8b-4ee5-b02e-3109f3ec2875]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:08 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f Jul 19 17:44:08 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Flow 'volume_create_manager' (e8d0f48b-8186-40de-91b1-2f5643d8f8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f3892d-12bb-49eb-a623-48964a1c9aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f3892d-12bb-49eb-a623-48964a1c9aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1559063926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d279ee95-24b0-4f07-a6c1-62d0b7df18e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806584263df84d4b802686645e3c4d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:09Z,use_quota=True,user_id='81c9a6f5a40643fa9e231cd31d171b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cc7592-a7e4-4a0f-b36b-b43dfc82cbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cc7592-a7e4-4a0f-b36b-b43dfc82cbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ae042a-7284-403b-90ff-8e5d817746d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ae042a-7284-403b-90ff-8e5d817746d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd279ee95-24b0-4f07-a6c1-62d0b7df18e1', 'volume_name': 'volume-d279ee95-24b0-4f07-a6c1-62d0b7df18e1', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daad4979-c3cc-434c-854e-4383b983e925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daad4979-c3cc-434c-854e-4383b983e925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2add7c41-10ae-4921-8e98-d20a7cf1a943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:08 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Volume d279ee95-24b0-4f07-a6c1-62d0b7df18e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d279ee95-24b0-4f07-a6c1-62d0b7df18e1', 'volume_size': 1} Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:08 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" returned: 0 in 0.532s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Image conversion details: src /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f, size 1024.00 MB, duration 4.62 sec, destination /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.3461c031-22d0-41a4-a9c2-2be0b560ce66s904067l.img {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:44:08 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Converted 1024.00 MB image at 221.66 MB/s Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] 3461c031-22d0-41a4-a9c2-2be0b560ce66 was raw, converting to qcow2 {{(pid=87676) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[232e0394-7987-468d-9c52-69cf5ff1af55]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.3461c031-22d0-41a4-a9c2-2be0b560ce66s904067l.img {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:08 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.3461c031-22d0-41a4-a9c2-2be0b560ce66s904067l.img Jul 19 17:44:08 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:09 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.3461c031-22d0-41a4-a9c2-2be0b560ce66s904067l.img" returned: 0 in 0.312s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.3461c031-22d0-41a4-a9c2-2be0b560ce66s904067l.img {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:09 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.3461c031-22d0-41a4-a9c2-2be0b560ce66s904067l.img Jul 19 17:44:09 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:09 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.3461c031-22d0-41a4-a9c2-2be0b560ce66s904067l.img" returned: 1 in 0.316s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.3461c031-22d0-41a4-a9c2-2be0b560ce66s904067l.img' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:44:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.3461c031-22d0-41a4-a9c2-2be0b560ce66s904067l.img /opt/stack/data/cinder/conversion/vol_upload_u6i2h064 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:09 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.3461c031-22d0-41a4-a9c2-2be0b560ce66s904067l.img /opt/stack/data/cinder/conversion/vol_upload_u6i2h064 Jul 19 17:44:09 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:09 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.3461c031-22d0-41a4-a9c2-2be0b560ce66s904067l.img /opt/stack/data/cinder/conversion/vol_upload_u6i2h064" returned: 0 in 0.251s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:09 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Image conversion details: src /opt/stack/data/cinder/conversion/cb4ea133-a3fb-4ec2-8bf7-ef292923a24f.temp_image.3461c031-22d0-41a4-a9c2-2be0b560ce66s904067l.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_u6i2h064 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:44:09 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 19 17:44:09 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae147ba-2492-4600-a917-f081bfc621c3]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u6i2h064 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:09 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u6i2h064 Jul 19 17:44:09 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:10 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u6i2h064" returned: 0 in 0.320s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.569s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Uploaded volume to glance image-id: 3461c031-22d0-41a4-a9c2-2be0b560ce66. {{(pid=87676) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 19 17:44:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.278s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-959797793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=050fd547-2711-4836-8bc8-bc307f422eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3e5e1f56bd46e399c01ff0f4c78dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:02Z,use_quota=True,user_id='d415bc6174b64d00bb7489974aaf1d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Creating volume 050fd547-2711-4836-8bc8-bc307f422eaa {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:11 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-050fd547-2711-4836-8bc8-bc307f422eaa 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:11 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-050fd547-2711-4836-8bc8-bc307f422eaa 1073741824 Jul 19 17:44:11 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:11 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-75093d96-7f26-414c-a7cd-9b9ddecf928c tempest-VolumesActionsTest-597051494 None] Copy volume to image completed successfully. Jul 19 17:44:11 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-050fd547-2711-4836-8bc8-bc307f422eaa 1073741824" returned: 0 in 0.403s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-050fd547-2711-4836-8bc8-bc307f422eaa {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:11 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-050fd547-2711-4836-8bc8-bc307f422eaa Jul 19 17:44:11 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:12 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-050fd547-2711-4836-8bc8-bc307f422eaa" returned: 0 in 0.232s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.392s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-881896655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e9634c-5f7f-4a66-bede-687d8baee46d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25f4b2830e748d5a11351c557d62fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:04Z,use_quota=True,user_id='a8eafb61039043f18d4ddc76e4990c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Creating volume 61e9634c-5f7f-4a66-bede-687d8baee46d {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:12 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-61e9634c-5f7f-4a66-bede-687d8baee46d 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db924df-b6c2-48ab-9e41-cf933a1684f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-050fd547-2711-4836-8bc8-bc307f422eaa', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:12 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-61e9634c-5f7f-4a66-bede-687d8baee46d 1073741824 Jul 19 17:44:12 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4b5734-fd1b-4e8e-80e3-73836ed89d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:12 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Volume volume-050fd547-2711-4836-8bc8-bc307f422eaa (050fd547-2711-4836-8bc8-bc307f422eaa): created successfully Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4b5734-fd1b-4e8e-80e3-73836ed89d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Flow 'volume_create_manager' (9e0bd70f-eb25-49ef-bb2b-588b9ccd5fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:12 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-555112ef-741a-4e1f-bbf6-aeaad98b8068 tempest-VolumesListAdminTestJSON-85698748 None] Created volume successfully. Jul 19 17:44:12 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-61e9634c-5f7f-4a66-bede-687d8baee46d 1073741824" returned: 0 in 0.424s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-61e9634c-5f7f-4a66-bede-687d8baee46d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:12 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-61e9634c-5f7f-4a66-bede-687d8baee46d Jul 19 17:44:12 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:12 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-61e9634c-5f7f-4a66-bede-687d8baee46d" returned: 0 in 0.268s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.132s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1559063926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d279ee95-24b0-4f07-a6c1-62d0b7df18e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806584263df84d4b802686645e3c4d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:09Z,use_quota=True,user_id='81c9a6f5a40643fa9e231cd31d171b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Creating volume d279ee95-24b0-4f07-a6c1-62d0b7df18e1 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:12 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d279ee95-24b0-4f07-a6c1-62d0b7df18e1 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c17579-869b-427b-9c85-693bb89725bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e9634c-5f7f-4a66-bede-687d8baee46d', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:12 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d279ee95-24b0-4f07-a6c1-62d0b7df18e1 1073741824 Jul 19 17:44:12 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9372a2d9-bd90-4e68-a45d-d467b03f583c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:12 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Volume volume-61e9634c-5f7f-4a66-bede-687d8baee46d (61e9634c-5f7f-4a66-bede-687d8baee46d): created successfully Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9372a2d9-bd90-4e68-a45d-d467b03f583c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Flow 'volume_create_manager' (9b094e8e-7cf5-4316-9e5d-64a6f1795cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:12 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-1cdd804b-e500-4a7d-9f92-09b40e34d0bf tempest-VolumesListTestJSON-2077666899 None] Created volume successfully. Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Acquiring lock "cinder-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Lock "cinder-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Acquiring lock "cinder-quobyte-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Lock "cinder-quobyte-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" acquired by "delete_volume" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4d0da1-5237-4043-806e-6d352d50df6b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:13 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d279ee95-24b0-4f07-a6c1-62d0b7df18e1 1073741824" returned: 0 in 0.667s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d279ee95-24b0-4f07-a6c1-62d0b7df18e1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:13 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f Jul 19 17:44:13 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:13 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d279ee95-24b0-4f07-a6c1-62d0b7df18e1 Jul 19 17:44:13 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Flow 'volume_create_manager' (16dafbb3-7483-4714-a729-7076635436ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304cb25b-26af-40ff-a3cb-3cd3f7ef4bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304cb25b-26af-40ff-a3cb-3cd3f7ef4bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1471497621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb783dd4-587d-47a1-9243-5004b1c03b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3e5e1f56bd46e399c01ff0f4c78dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:14Z,use_quota=True,user_id='d415bc6174b64d00bb7489974aaf1d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bebef11-3121-4e24-a4dd-27f68c1caa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bebef11-3121-4e24-a4dd-27f68c1caa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047e76ec-cf46-44f1-b703-bb7c77970918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047e76ec-cf46-44f1-b703-bb7c77970918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb783dd4-587d-47a1-9243-5004b1c03b31', 'volume_name': 'volume-fb783dd4-587d-47a1-9243-5004b1c03b31', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8429d92c-3088-403f-a478-02d125b53624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8429d92c-3088-403f-a478-02d125b53624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9054630-8e1d-449d-930a-8f758b9dc2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:13 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Volume fb783dd4-587d-47a1-9243-5004b1c03b31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb783dd4-587d-47a1-9243-5004b1c03b31', 'volume_size': 1} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:13 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d279ee95-24b0-4f07-a6c1-62d0b7df18e1" returned: 0 in 0.360s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.090s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1471497621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb783dd4-587d-47a1-9243-5004b1c03b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3e5e1f56bd46e399c01ff0f4c78dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:14Z,use_quota=True,user_id='d415bc6174b64d00bb7489974aaf1d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Creating volume fb783dd4-587d-47a1-9243-5004b1c03b31 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:13 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb783dd4-587d-47a1-9243-5004b1c03b31 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:13 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2add7c41-10ae-4921-8e98-d20a7cf1a943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d279ee95-24b0-4f07-a6c1-62d0b7df18e1', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c2d6937-2bc5-4963-8ab6-6a48b6adc613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:13 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb783dd4-587d-47a1-9243-5004b1c03b31 1073741824 Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" returned: 0 in 0.622s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:13 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:13 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Volume volume-d279ee95-24b0-4f07-a6c1-62d0b7df18e1 (d279ee95-24b0-4f07-a6c1-62d0b7df18e1): created successfully Jul 19 17:44:13 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f Jul 19 17:44:13 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c2d6937-2bc5-4963-8ab6-6a48b6adc613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Flow 'volume_create_manager' (e8d0f48b-8186-40de-91b1-2f5643d8f8f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-5fe5d277-c395-4625-bb8f-516f97b9de64 tempest-VolumesTransfersTest-792087820 None] Created volume successfully. Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:44:14 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Flow 'volume_create_manager' (06be7f67-ffc0-4a88-8018-465d4c0c3ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b057c51b-c0f5-45a6-96bd-807c410c06c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" returned: 0 in 0.320s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b057c51b-c0f5-45a6-96bd-807c410c06c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2041172924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37e3c6f-05e5-4d2a-a055-07e6483090c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25f4b2830e748d5a11351c557d62fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:14Z,use_quota=True,user_id='a8eafb61039043f18d4ddc76e4990c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7678d8-33ba-454e-b15a-45db5dbf6c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7678d8-33ba-454e-b15a-45db5dbf6c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7759f12c-d6e1-49c5-a74b-d23acdb9fa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7759f12c-d6e1-49c5-a74b-d23acdb9fa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a37e3c6f-05e5-4d2a-a055-07e6483090c1', 'volume_name': 'volume-a37e3c6f-05e5-4d2a-a055-07e6483090c1', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130f923f-dba1-46eb-a1b7-40e9bc969ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130f923f-dba1-46eb-a1b7-40e9bc969ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607e3745-39d5-413d-b50a-c009dd7c5888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:14 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Volume a37e3c6f-05e5-4d2a-a055-07e6483090c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a37e3c6f-05e5-4d2a-a055-07e6483090c1', 'volume_size': 1} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Lock "cinder-quobyte-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f" released by "delete_volume" :: held 1.040s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Created reservations ['f6cfe614-c460-4259-9bb8-9ccd28d39af0', 'db6b435f-66e6-4ed8-9a5c-22a77601837b', '39bfc4f6-2b9a-4e2b-9b98-bd936df45747', '9c90694c-bd10-42f0-8f07-4004ae8ab703'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:14 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb783dd4-587d-47a1-9243-5004b1c03b31 1073741824" returned: 0 in 0.500s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb783dd4-587d-47a1-9243-5004b1c03b31 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:14 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:14 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:14 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb783dd4-587d-47a1-9243-5004b1c03b31 Jul 19 17:44:14 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:14 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.244s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Deleted volume successfully. Jul 19 17:44:14 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb783dd4-587d-47a1-9243-5004b1c03b31" returned: 0 in 0.244s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.384s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2041172924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37e3c6f-05e5-4d2a-a055-07e6483090c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25f4b2830e748d5a11351c557d62fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:14Z,use_quota=True,user_id='a8eafb61039043f18d4ddc76e4990c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Creating volume a37e3c6f-05e5-4d2a-a055-07e6483090c1 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:14 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a37e3c6f-05e5-4d2a-a055-07e6483090c1 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9054630-8e1d-449d-930a-8f758b9dc2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb783dd4-587d-47a1-9243-5004b1c03b31', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:14 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a37e3c6f-05e5-4d2a-a055-07e6483090c1 1073741824 Jul 19 17:44:14 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a318aad4-f33c-4070-8910-0a4c86ff4585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-63b92f11-b1ef-4dbd-bd64-4fe32c779946 tempest-VolumesActionsTest-597051494 None] Lock "cinder-cb4ea133-a3fb-4ec2-8bf7-ef292923a24f-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:14 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Volume volume-fb783dd4-587d-47a1-9243-5004b1c03b31 (fb783dd4-587d-47a1-9243-5004b1c03b31): created successfully Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a318aad4-f33c-4070-8910-0a4c86ff4585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Flow 'volume_create_manager' (16dafbb3-7483-4714-a729-7076635436ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-aba01204-5e4c-442c-9af8-eb3039477c9b tempest-VolumesListAdminTestJSON-85698748 None] Created volume successfully. Jul 19 17:44:15 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a37e3c6f-05e5-4d2a-a055-07e6483090c1 1073741824" returned: 0 in 0.446s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a37e3c6f-05e5-4d2a-a055-07e6483090c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:15 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a37e3c6f-05e5-4d2a-a055-07e6483090c1 Jul 19 17:44:15 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Acquiring lock "cinder-d279ee95-24b0-4f07-a6c1-62d0b7df18e1-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Lock "cinder-d279ee95-24b0-4f07-a6c1-62d0b7df18e1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Acquiring lock "cinder-quobyte-d279ee95-24b0-4f07-a6c1-62d0b7df18e1" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Lock "cinder-quobyte-d279ee95-24b0-4f07-a6c1-62d0b7df18e1" acquired by "delete_volume" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea4cd1e-6116-440c-9768-eb6c7b02d784]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d279ee95-24b0-4f07-a6c1-62d0b7df18e1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:15 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a37e3c6f-05e5-4d2a-a055-07e6483090c1" returned: 0 in 0.275s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:15 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d279ee95-24b0-4f07-a6c1-62d0b7df18e1 Jul 19 17:44:15 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607e3745-39d5-413d-b50a-c009dd7c5888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a37e3c6f-05e5-4d2a-a055-07e6483090c1', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ea6d40-af76-482f-b550-4e24222d71b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:15 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Volume volume-a37e3c6f-05e5-4d2a-a055-07e6483090c1 (a37e3c6f-05e5-4d2a-a055-07e6483090c1): created successfully Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ea6d40-af76-482f-b550-4e24222d71b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Flow 'volume_create_manager' (06be7f67-ffc0-4a88-8018-465d4c0c3ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:15 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-2c0f0b79-dca7-44c5-9a90-665f7eea4157 tempest-VolumesListTestJSON-2077666899 None] Created volume successfully. Jul 19 17:44:15 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d279ee95-24b0-4f07-a6c1-62d0b7df18e1" returned: 0 in 0.401s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d279ee95-24b0-4f07-a6c1-62d0b7df18e1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:15 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d279ee95-24b0-4f07-a6c1-62d0b7df18e1 Jul 19 17:44:15 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:16 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d279ee95-24b0-4f07-a6c1-62d0b7df18e1" returned: 0 in 0.275s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Lock "cinder-quobyte-d279ee95-24b0-4f07-a6c1-62d0b7df18e1" released by "delete_volume" :: held 0.734s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Created reservations ['14f57200-483f-4094-bca8-474ebb4c23d8', '6380f94d-175c-4aa3-8526-f93a7bdef583', 'd3a904d3-b478-4805-ad92-52e8488d0670', 'bfb8f22a-5222-4f54-b6e0-0df072e50e0c'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:16 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:16 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:16 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.345s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:16 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Deleted volume successfully. Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Flow 'volume_create_manager' (6b4dcd66-5503-477e-a051-9a290bcff324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c596b4c-c4a4-4512-b29b-4b9b0b8c90fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c596b4c-c4a4-4512-b29b-4b9b0b8c90fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d9a846-7c69-4264-8e65-e686ea69f961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45e52f3f791b45b5be0d9b0722379193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:17Z,use_quota=True,user_id='ebff988a587e44879f1dcfbd72e5e5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9adb6ea5-14ce-438c-9c9f-e8ed305a1eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9adb6ea5-14ce-438c-9c9f-e8ed305a1eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37743aef-b7a6-40a5-a4ab-2418d237d357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37743aef-b7a6-40a5-a4ab-2418d237d357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87d9a846-7c69-4264-8e65-e686ea69f961', 'volume_name': 'volume-87d9a846-7c69-4264-8e65-e686ea69f961', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2df2b53-15d5-4fdc-8a1e-08c8c805f5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2df2b53-15d5-4fdc-8a1e-08c8c805f5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce18fcf-9adb-4912-bc7f-9e8297d58cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:16 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Volume 87d9a846-7c69-4264-8e65-e686ea69f961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87d9a846-7c69-4264-8e65-e686ea69f961', 'volume_size': 1} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d9a846-7c69-4264-8e65-e686ea69f961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45e52f3f791b45b5be0d9b0722379193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:17Z,use_quota=True,user_id='ebff988a587e44879f1dcfbd72e5e5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Creating volume 87d9a846-7c69-4264-8e65-e686ea69f961 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:16 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-87d9a846-7c69-4264-8e65-e686ea69f961 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:16 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ab1d26f-6a25-4a26-8d9e-a514b282788d tempest-VolumesTransfersTest-372594058 None] Lock "cinder-d279ee95-24b0-4f07-a6c1-62d0b7df18e1-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:16 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-87d9a846-7c69-4264-8e65-e686ea69f961 1073741824 Jul 19 17:44:16 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:17 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-87d9a846-7c69-4264-8e65-e686ea69f961 1073741824" returned: 0 in 0.577s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-87d9a846-7c69-4264-8e65-e686ea69f961 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:17 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-87d9a846-7c69-4264-8e65-e686ea69f961 Jul 19 17:44:17 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:17 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-87d9a846-7c69-4264-8e65-e686ea69f961" returned: 0 in 0.279s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce18fcf-9adb-4912-bc7f-9e8297d58cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d9a846-7c69-4264-8e65-e686ea69f961', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff80bb85-972b-4585-86df-3e46ede3ffe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:17 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Volume volume-87d9a846-7c69-4264-8e65-e686ea69f961 (87d9a846-7c69-4264-8e65-e686ea69f961): created successfully Jul 19 17:44:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff80bb85-972b-4585-86df-3e46ede3ffe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Flow 'volume_create_manager' (6b4dcd66-5503-477e-a051-9a290bcff324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:17 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-5c2d2727-609a-427e-95eb-cf09fde471c3 tempest-VolumesListAdminTestJSON-1184536892 None] Created volume successfully. Jul 19 17:44:18 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Acquiring lock "cinder-87d9a846-7c69-4264-8e65-e686ea69f961-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:18 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Lock "cinder-87d9a846-7c69-4264-8e65-e686ea69f961-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:18 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Acquiring lock "cinder-quobyte-87d9a846-7c69-4264-8e65-e686ea69f961" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:18 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Lock "cinder-quobyte-87d9a846-7c69-4264-8e65-e686ea69f961" acquired by "delete_volume" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:18 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7dfff2-eff3-439f-86f1-99cf5942c113]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-87d9a846-7c69-4264-8e65-e686ea69f961 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Acquiring lock "cinder-fb783dd4-587d-47a1-9243-5004b1c03b31-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Lock "cinder-fb783dd4-587d-47a1-9243-5004b1c03b31-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:19 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-87d9a846-7c69-4264-8e65-e686ea69f961 Jul 19 17:44:19 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Acquiring lock "cinder-quobyte-fb783dd4-587d-47a1-9243-5004b1c03b31" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Lock "cinder-quobyte-fb783dd4-587d-47a1-9243-5004b1c03b31" acquired by "delete_volume" :: waited 0.073s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:19 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e402dc-a07e-41a4-b826-a9398a3e6c64]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb783dd4-587d-47a1-9243-5004b1c03b31 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:19 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-87d9a846-7c69-4264-8e65-e686ea69f961" returned: 0 in 0.533s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-87d9a846-7c69-4264-8e65-e686ea69f961 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:19 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-87d9a846-7c69-4264-8e65-e686ea69f961 Jul 19 17:44:19 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:19 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb783dd4-587d-47a1-9243-5004b1c03b31 Jul 19 17:44:19 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:19 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-87d9a846-7c69-4264-8e65-e686ea69f961" returned: 0 in 0.346s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Lock "cinder-quobyte-87d9a846-7c69-4264-8e65-e686ea69f961" released by "delete_volume" :: held 0.950s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:19 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Created reservations ['e83f8933-61b4-4166-8b19-e4a02e6eaafd', '523cbe0e-8393-463c-a226-cf34141ce991', 'f460ef30-ce4a-4018-b893-d9532077616f', '982982a5-c67e-4a63-952a-44d0fc21e6fb'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:19 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb783dd4-587d-47a1-9243-5004b1c03b31" returned: 0 in 0.596s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb783dd4-587d-47a1-9243-5004b1c03b31 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Acquiring lock "cinder-a37e3c6f-05e5-4d2a-a055-07e6483090c1-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:20 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb783dd4-587d-47a1-9243-5004b1c03b31 Jul 19 17:44:20 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Lock "cinder-a37e3c6f-05e5-4d2a-a055-07e6483090c1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Acquiring lock "cinder-quobyte-a37e3c6f-05e5-4d2a-a055-07e6483090c1" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Lock "cinder-quobyte-a37e3c6f-05e5-4d2a-a055-07e6483090c1" acquired by "delete_volume" :: waited 0.056s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:20 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:20 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9b7583-f8ca-4dc2-b4d8-8956b25ced10]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a37e3c6f-05e5-4d2a-a055-07e6483090c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:20 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a37e3c6f-05e5-4d2a-a055-07e6483090c1 Jul 19 17:44:20 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:20 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb783dd4-587d-47a1-9243-5004b1c03b31" returned: 0 in 0.497s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:20 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Lock "cinder-quobyte-fb783dd4-587d-47a1-9243-5004b1c03b31" released by "delete_volume" :: held 1.186s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.351s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:20 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Deleted volume successfully. Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f5aa86f3-f642-4674-9c34-c18dd55147b1 tempest-VolumesListAdminTestJSON-1184536892 None] Lock "cinder-87d9a846-7c69-4264-8e65-e686ea69f961-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Created reservations ['49408a4b-b358-468f-b5a3-03a25d0257a3', '7d384836-4d42-474d-b3fb-8d7108b18232', '9907b476-29f8-4ac4-99dd-ccc268aa930f', 'ae5c9ea2-9c9f-4905-9011-d6610a51917b'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:20 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:20 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:20 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a37e3c6f-05e5-4d2a-a055-07e6483090c1" returned: 0 in 0.589s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a37e3c6f-05e5-4d2a-a055-07e6483090c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:20 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a37e3c6f-05e5-4d2a-a055-07e6483090c1 Jul 19 17:44:20 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:21 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.310s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:21 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:21 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Deleted volume successfully. Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a37e3c6f-05e5-4d2a-a055-07e6483090c1" returned: 0 in 0.297s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Lock "cinder-quobyte-a37e3c6f-05e5-4d2a-a055-07e6483090c1" released by "delete_volume" :: held 0.955s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bdee8820-f96f-4e27-b0ee-559449e164e7 tempest-VolumesListAdminTestJSON-85698748 None] Lock "cinder-fb783dd4-587d-47a1-9243-5004b1c03b31-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Created reservations ['c8882844-bf54-4c0a-9140-f14384db039b', 'e03f8bfb-48ac-4569-8726-335dd1bac49e', '94778873-6f68-4f54-a6a7-3735d896c1cf', 'caab1d5c-3e8e-47ad-91ed-53053d60b802'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:21 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:21 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Acquiring lock "cinder-050fd547-2711-4836-8bc8-bc307f422eaa-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Lock "cinder-050fd547-2711-4836-8bc8-bc307f422eaa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:21 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.369s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Acquiring lock "cinder-quobyte-050fd547-2711-4836-8bc8-bc307f422eaa" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:21 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Deleted volume successfully. Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Lock "cinder-quobyte-050fd547-2711-4836-8bc8-bc307f422eaa" acquired by "delete_volume" :: waited 0.033s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a8421393-8ff7-4f53-bc8c-9a9ebb95af61 tempest-VolumesListTestJSON-2077666899 None] Lock "cinder-a37e3c6f-05e5-4d2a-a055-07e6483090c1-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90562f4-1f17-4b4f-8d89-c5cbee1ba5e5]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-050fd547-2711-4836-8bc8-bc307f422eaa {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:21 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-050fd547-2711-4836-8bc8-bc307f422eaa Jul 19 17:44:21 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:22 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-050fd547-2711-4836-8bc8-bc307f422eaa" returned: 0 in 0.393s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-050fd547-2711-4836-8bc8-bc307f422eaa {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:22 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-050fd547-2711-4836-8bc8-bc307f422eaa Jul 19 17:44:22 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Acquiring lock "cinder-61e9634c-5f7f-4a66-bede-687d8baee46d-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Lock "cinder-61e9634c-5f7f-4a66-bede-687d8baee46d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Acquiring lock "cinder-quobyte-61e9634c-5f7f-4a66-bede-687d8baee46d" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:22 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-050fd547-2711-4836-8bc8-bc307f422eaa" returned: 0 in 0.343s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Lock "cinder-quobyte-050fd547-2711-4836-8bc8-bc307f422eaa" released by "delete_volume" :: held 0.799s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Lock "cinder-quobyte-61e9634c-5f7f-4a66-bede-687d8baee46d" acquired by "delete_volume" :: waited 0.035s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77e807f-aca7-4044-b7f8-b686942f42e8]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-61e9634c-5f7f-4a66-bede-687d8baee46d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Created reservations ['422ae1aa-ea93-4697-bcba-3c9dd2ec21e4', 'd1b4d6d8-ce30-42a6-82ab-0b93d36355b0', '1437cca7-fbff-47f4-8e88-7126d09b3d1c', '5b00e73f-d9d2-40ac-b2c2-3ed03366b639'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:22 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-61e9634c-5f7f-4a66-bede-687d8baee46d Jul 19 17:44:22 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:22 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:22 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Acquiring lock "cinder-3c4a263f-9826-47f6-8bec-71ad35dd7a43-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Lock "cinder-3c4a263f-9826-47f6-8bec-71ad35dd7a43-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Acquiring lock "cinder-quobyte-3c4a263f-9826-47f6-8bec-71ad35dd7a43" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:23 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.301s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Deleted volume successfully. Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Lock "cinder-quobyte-3c4a263f-9826-47f6-8bec-71ad35dd7a43" acquired by "delete_volume" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7bfc254b-9300-4381-b24d-afd98cea08a5 tempest-VolumesListAdminTestJSON-85698748 None] Lock "cinder-050fd547-2711-4836-8bc8-bc307f422eaa-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb98176-46b0-4de6-9501-e21e2c3c7a60]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3c4a263f-9826-47f6-8bec-71ad35dd7a43 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:23 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-61e9634c-5f7f-4a66-bede-687d8baee46d" returned: 0 in 0.607s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-61e9634c-5f7f-4a66-bede-687d8baee46d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:23 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-61e9634c-5f7f-4a66-bede-687d8baee46d Jul 19 17:44:23 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:23 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3c4a263f-9826-47f6-8bec-71ad35dd7a43 Jul 19 17:44:23 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:23 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-61e9634c-5f7f-4a66-bede-687d8baee46d" returned: 0 in 0.317s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Lock "cinder-quobyte-61e9634c-5f7f-4a66-bede-687d8baee46d" released by "delete_volume" :: held 0.977s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:23 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3c4a263f-9826-47f6-8bec-71ad35dd7a43" returned: 0 in 0.483s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3c4a263f-9826-47f6-8bec-71ad35dd7a43 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:23 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3c4a263f-9826-47f6-8bec-71ad35dd7a43 Jul 19 17:44:23 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Created reservations ['2bd42681-fcde-4187-9489-dfe9c3ad30f2', '6304910e-98a5-4fdd-9602-db805ab4eaeb', '7277602e-c749-422c-a879-fc36b143dbd6', 'a25dda4e-dd9a-411e-a5bb-51beba77ed3c'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:23 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:23 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:23 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3c4a263f-9826-47f6-8bec-71ad35dd7a43" returned: 0 in 0.314s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Lock "cinder-quobyte-3c4a263f-9826-47f6-8bec-71ad35dd7a43" released by "delete_volume" :: held 0.863s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:23 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Created reservations ['bb387451-c92a-4fb3-b8f8-956a6aab8e87', '3031edbb-efc3-467b-beae-de775de1d969', 'd95f54f1-5b81-43b4-9ece-77f477b70794', '94dbaa18-c8d1-4dd1-a342-09336864bdd9'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:24 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.308s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:24 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Deleted volume successfully. Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-156d4fd2-c888-46e6-a768-3e6e959d3316 tempest-VolumesListTestJSON-2077666899 None] Lock "cinder-61e9634c-5f7f-4a66-bede-687d8baee46d-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:24 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:24 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Flow 'volume_create_manager' (a8457eac-0f2b-4654-ad27-83a1acd07353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6499729-94f3-487f-ab82-795a21827ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:24 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6499729-94f3-487f-ab82-795a21827ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-981789507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e90ab4f-4ce8-46d9-b50a-5f1176707f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fd5e1bf38a4f08806626cddfd7d6ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:24Z,use_quota=True,user_id='5aceecf8f992436fa79e7ec4babb960c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee596005-540d-42f6-a6b6-a22ac679f708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee596005-540d-42f6-a6b6-a22ac679f708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfffe338-3b92-418b-9b10-3f03442bee10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.image.glance [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Creating Keystone auth plugin from conf {{(pid=87676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.384s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:24 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Deleted volume successfully. Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-364e11d7-4d0c-4409-99c3-828dcc25b8d1 tempest-VolumesListAdminTestJSON-85698748 None] Lock "cinder-3c4a263f-9826-47f6-8bec-71ad35dd7a43-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Acquiring lock "cinder-cf5b7461-ffd9-4047-afb5-e6222d1ad712-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Lock "cinder-cf5b7461-ffd9-4047-afb5-e6222d1ad712-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Acquiring lock "cinder-quobyte-cf5b7461-ffd9-4047-afb5-e6222d1ad712" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Lock "cinder-quobyte-cf5b7461-ffd9-4047-afb5-e6222d1ad712" acquired by "delete_volume" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4fbaa4-7a12-438a-a5de-a4200b4e04bd]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cf5b7461-ffd9-4047-afb5-e6222d1ad712 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:25 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cf5b7461-ffd9-4047-afb5-e6222d1ad712 Jul 19 17:44:25 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfffe338-3b92-418b-9b10-3f03442bee10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e90ab4f-4ce8-46d9-b50a-5f1176707f96', 'volume_name': 'volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96', 'volume_size': 1, 'image_id': '3f690ae5-6466-476d-bb48-a634301656d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b6bd91692f74fd082fc706a6071a464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3f690ae5-6466-476d-bb48-a634301656d0', 'created_at': datetime.datetime(2026, 7, 19, 15, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 29, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f690ae5-6466-476d-bb48-a634301656d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298fa170-788d-48e5-ae07-ff90d3cd2917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298fa170-788d-48e5-ae07-ff90d3cd2917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e55154-ad76-4493-8a9f-7714439a1917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:25 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Volume 9e90ab4f-4ce8-46d9-b50a-5f1176707f96: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96', 'volume_size': 1, 'image_id': '3f690ae5-6466-476d-bb48-a634301656d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b6bd91692f74fd082fc706a6071a464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3f690ae5-6466-476d-bb48-a634301656d0', 'created_at': datetime.datetime(2026, 7, 19, 15, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 29, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f690ae5-6466-476d-bb48-a634301656d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Trying to clone 9e90ab4f-4ce8-46d9-b50a-5f1176707f96 from image 3f690ae5-6466-476d-bb48-a634301656d0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}]). {{(pid=87676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 17:44:25 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cf5b7461-ffd9-4047-afb5-e6222d1ad712" returned: 0 in 0.507s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cf5b7461-ffd9-4047-afb5-e6222d1ad712 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:25 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cf5b7461-ffd9-4047-afb5-e6222d1ad712 Jul 19 17:44:25 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ekpop9lpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 17:44:25 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Image download 20.69 MB at 20.69 MB/s Jul 19 17:44:25 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cf5b7461-ffd9-4047-afb5-e6222d1ad712" returned: 0 in 0.332s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Lock "cinder-quobyte-cf5b7461-ffd9-4047-afb5-e6222d1ad712" released by "delete_volume" :: held 0.897s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[651888ac-cc67-4714-bf10-00acbcbe1184]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ekpop9lpdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Created reservations ['6167b763-a320-4dde-b5d3-34eadb46f838', '7d510d0c-a01d-45a1-908b-8142f2269b55', 'a82a9519-da14-4ed4-9f69-5aa67aa27e0a', '857a4edd-4b42-4493-83de-8e0909a886e5'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:25 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ekpop9lpdevstack@QuobyteHD Jul 19 17:44:25 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:26 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:26 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:26 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ekpop9lpdevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Temporary image 3f690ae5-6466-476d-bb48-a634301656d0 is fetched for user 5aceecf8f992436fa79e7ec4babb960c. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 17:44:26 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc43db2-0daf-44ae-bbd6-47bf86f1266b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.392s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ekpop9lpdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:26 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Deleted volume successfully. Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-853722cd-4e1b-4281-89c9-2efcfee5bea1 tempest-VolumesListTestJSON-2077666899 None] Lock "cinder-cf5b7461-ffd9-4047-afb5-e6222d1ad712-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:26 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ekpop9lpdevstack@QuobyteHD Jul 19 17:44:26 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Flow 'volume_create_manager' (ad0c197d-5c56-49e3-a671-ff223e5939fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4110d3-b86b-42ea-8701-d90c99122cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4110d3-b86b-42ea-8701-d90c99122cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-897149664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d82bace-e44b-49d2-b8af-8dbdd67df117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c33da8e65a44f278df5f9f7981e7823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:27Z,use_quota=True,user_id='27a665eb42c743d1a13599561da852d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022bf635-c013-4f3a-95df-9a3f2ee14843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022bf635-c013-4f3a-95df-9a3f2ee14843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d246a65f-2309-4d6a-8779-42e9580682db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d246a65f-2309-4d6a-8779-42e9580682db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d82bace-e44b-49d2-b8af-8dbdd67df117', 'volume_name': 'volume-1d82bace-e44b-49d2-b8af-8dbdd67df117', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0931858-3ee0-4461-8c45-de8465d0d38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0931858-3ee0-4461-8c45-de8465d0d38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f64420-9cd5-45f1-af1c-3e075409691f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:26 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Volume 1d82bace-e44b-49d2-b8af-8dbdd67df117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d82bace-e44b-49d2-b8af-8dbdd67df117', 'volume_size': 1} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-897149664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d82bace-e44b-49d2-b8af-8dbdd67df117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c33da8e65a44f278df5f9f7981e7823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:27Z,use_quota=True,user_id='27a665eb42c743d1a13599561da852d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Creating volume 1d82bace-e44b-49d2-b8af-8dbdd67df117 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:26 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1d82bace-e44b-49d2-b8af-8dbdd67df117 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:26 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ekpop9lpdevstack@QuobyteHD" returned: 0 in 0.589s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:26 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1d82bace-e44b-49d2-b8af-8dbdd67df117 1073741824 Jul 19 17:44:26 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:27 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1d82bace-e44b-49d2-b8af-8dbdd67df117 1073741824" returned: 0 in 0.550s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1d82bace-e44b-49d2-b8af-8dbdd67df117 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:27 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1d82bace-e44b-49d2-b8af-8dbdd67df117 Jul 19 17:44:27 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:27 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1d82bace-e44b-49d2-b8af-8dbdd67df117" returned: 0 in 0.303s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.880s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-981789507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e90ab4f-4ce8-46d9-b50a-5f1176707f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fd5e1bf38a4f08806626cddfd7d6ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:24Z,use_quota=True,user_id='5aceecf8f992436fa79e7ec4babb960c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Creating volume 9e90ab4f-4ce8-46d9-b50a-5f1176707f96 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:27 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f64420-9cd5-45f1-af1c-3e075409691f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d82bace-e44b-49d2-b8af-8dbdd67df117', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba89a91-9801-4fc8-8e66-2a961c75b2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:27 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 1073741824 Jul 19 17:44:27 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:27 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Volume volume-1d82bace-e44b-49d2-b8af-8dbdd67df117 (1d82bace-e44b-49d2-b8af-8dbdd67df117): created successfully Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba89a91-9801-4fc8-8e66-2a961c75b2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Flow 'volume_create_manager' (ad0c197d-5c56-49e3-a671-ff223e5939fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:27 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a619abf9-c078-426c-a450-7b1f66433e73 tempest-VolumesTransfersV355Test-1434929086 None] Created volume successfully. Jul 19 17:44:28 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 1073741824" returned: 0 in 0.499s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:28 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 Jul 19 17:44:28 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:28 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96" returned: 0 in 0.279s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:28 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Attempting download of 3f690ae5-6466-476d-bb48-a634301656d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}])) to volume 9e90ab4f-4ce8-46d9-b50a-5f1176707f96. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 17:44:28 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9403270b-b464-4ba5-b63e-8e482a7a6f24]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_xpfam90z {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:28 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_xpfam90z Jul 19 17:44:28 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:29 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_xpfam90z" returned: 0 in 0.456s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_xpfam90z {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:29 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_xpfam90z Jul 19 17:44:29 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:29 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-693ed419-36db-4c2b-824b-62b7fcdb8f5b tempest-VolumesTransfersV355Test-555197309 None] Transfer volume completed successfully. Jul 19 17:44:29 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_xpfam90z" returned: 1 in 0.463s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_xpfam90z' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:44:29 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af706dd-839c-4a2f-ba1e-d40b90573fef]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ekpop9lpdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:29 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ekpop9lpdevstack@QuobyteHD Jul 19 17:44:29 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:30 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ekpop9lpdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:30 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] 3f690ae5-6466-476d-bb48-a634301656d0 was qcow2, converting to qcow2 {{(pid=87676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 17:44:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ekpop9lpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:30 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ekpop9lpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 Jul 19 17:44:30 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Acquiring lock "cinder-1d82bace-e44b-49d2-b8af-8dbdd67df117-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Lock "cinder-1d82bace-e44b-49d2-b8af-8dbdd67df117-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Acquiring lock "cinder-quobyte-1d82bace-e44b-49d2-b8af-8dbdd67df117" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Lock "cinder-quobyte-1d82bace-e44b-49d2-b8af-8dbdd67df117" acquired by "delete_volume" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:30 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae67b8c-5da9-4a6d-aeff-784025a8d13c]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1d82bace-e44b-49d2-b8af-8dbdd67df117 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:30 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1d82bace-e44b-49d2-b8af-8dbdd67df117 Jul 19 17:44:30 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:31 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1d82bace-e44b-49d2-b8af-8dbdd67df117" returned: 0 in 0.463s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1d82bace-e44b-49d2-b8af-8dbdd67df117 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:31 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1d82bace-e44b-49d2-b8af-8dbdd67df117 Jul 19 17:44:31 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:31 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1d82bace-e44b-49d2-b8af-8dbdd67df117" returned: 0 in 0.288s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:31 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Lock "cinder-quobyte-1d82bace-e44b-49d2-b8af-8dbdd67df117" released by "delete_volume" :: held 0.812s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:31 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Created reservations ['6b3bf8b6-5d6c-4f4f-8437-a2714976fe88', '2cd8c216-6ad8-462a-a127-31dda667c110', '47be76f5-8e16-4912-a2ce-95a67f26c18f', 'd241b389-6d66-46b4-92c8-4caf40ed989d'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:31 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:31 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:32 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.488s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Deleted volume successfully. Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-857ecf09-bcf0-4e68-81e9-170d04175478 tempest-VolumesTransfersV355Test-630089658 None] Lock "cinder-1d82bace-e44b-49d2-b8af-8dbdd67df117-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:32 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ekpop9lpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96" returned: 0 in 2.627s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_ekpop9lpdevstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:44:32 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Converted 112.00 MB image at 42.61 MB/s Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:44:32 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 1G Jul 19 17:44:32 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Flow 'volume_create_manager' (b97ca952-e266-44d8-99df-5cfd39465b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5767b99c-fdf2-47e9-a9d3-cd8a26183ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5767b99c-fdf2-47e9-a9d3-cd8a26183ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1093861130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355f9fee-2868-45fb-9756-9eccda253e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c33da8e65a44f278df5f9f7981e7823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:33Z,use_quota=True,user_id='27a665eb42c743d1a13599561da852d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c0c880-31be-4ede-9cfc-a553458f72c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c0c880-31be-4ede-9cfc-a553458f72c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc80546d-dddb-4143-a113-41f6e5d2cf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc80546d-dddb-4143-a113-41f6e5d2cf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '355f9fee-2868-45fb-9756-9eccda253e25', 'volume_name': 'volume-355f9fee-2868-45fb-9756-9eccda253e25', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee5b074-bae5-4c27-a5c8-870e5864903c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee5b074-bae5-4c27-a5c8-870e5864903c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd69b48-bd29-46f5-ae6d-e92ea9f5272f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:32 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Volume 355f9fee-2868-45fb-9756-9eccda253e25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-355f9fee-2868-45fb-9756-9eccda253e25', 'volume_size': 1} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1093861130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355f9fee-2868-45fb-9756-9eccda253e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c33da8e65a44f278df5f9f7981e7823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:33Z,use_quota=True,user_id='27a665eb42c743d1a13599561da852d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Creating volume 355f9fee-2868-45fb-9756-9eccda253e25 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:32 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-355f9fee-2868-45fb-9756-9eccda253e25 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:32 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-355f9fee-2868-45fb-9756-9eccda253e25 1073741824 Jul 19 17:44:32 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Flow 'volume_create_manager' (da817ce3-66db-4e62-9534-b779e6045be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f1a3c2-b2d2-4733-b79d-f462379261f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f1a3c2-b2d2-4733-b79d-f462379261f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1065223873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6283820f-107a-4a92-bc91-a7425be0498e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781117569e934055a5dd9a7f46b8ee62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:33Z,use_quota=True,user_id='7e837a729e7d490b9345dc47a53d6812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f9df51-68dc-43a2-9a51-e8482db3b748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f9df51-68dc-43a2-9a51-e8482db3b748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4173efb-65ad-4bd3-9a4f-a347c4422098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4173efb-65ad-4bd3-9a4f-a347c4422098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6283820f-107a-4a92-bc91-a7425be0498e', 'volume_name': 'volume-6283820f-107a-4a92-bc91-a7425be0498e', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23391527-121b-4edc-a989-af2c1c21eacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23391527-121b-4edc-a989-af2c1c21eacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e539a3-910a-4558-b2c8-e9012628f58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:33 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Volume 6283820f-107a-4a92-bc91-a7425be0498e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6283820f-107a-4a92-bc91-a7425be0498e', 'volume_size': 1} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:33 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 1G" returned: 0 in 0.388s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Downloaded image 3f690ae5-6466-476d-bb48-a634301656d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}])) to volume 9e90ab4f-4ce8-46d9-b50a-5f1176707f96 successfully. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Temporary image 3f690ae5-6466-476d-bb48-a634301656d0 for user 5aceecf8f992436fa79e7ec4babb960c is deleted. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Marking volume 9e90ab4f-4ce8-46d9-b50a-5f1176707f96 as bootable. {{(pid=87676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Copying metadata from image 3f690ae5-6466-476d-bb48-a634301656d0 to 9e90ab4f-4ce8-46d9-b50a-5f1176707f96. {{(pid=87676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Creating volume glance metadata for volume 9e90ab4f-4ce8-46d9-b50a-5f1176707f96 backed by image 3f690ae5-6466-476d-bb48-a634301656d0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3f690ae5-6466-476d-bb48-a634301656d0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e55154-ad76-4493-8a9f-7714439a1917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96', 'volume_size': 1, 'image_id': '3f690ae5-6466-476d-bb48-a634301656d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b6bd91692f74fd082fc706a6071a464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3f690ae5-6466-476d-bb48-a634301656d0', 'created_at': datetime.datetime(2026, 7, 19, 15, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 29, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f690ae5-6466-476d-bb48-a634301656d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711bdad6-77b6-43c7-9143-1991e6180408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:33 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Volume volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 (9e90ab4f-4ce8-46d9-b50a-5f1176707f96): created successfully Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711bdad6-77b6-43c7-9143-1991e6180408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Flow 'volume_create_manager' (a8457eac-0f2b-4654-ad27-83a1acd07353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:33 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-96a44a51-50c5-43c4-9575-3a7899766fe0 tempest-VolumesExtendTest-1547047626 None] Created volume successfully. Jul 19 17:44:33 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-355f9fee-2868-45fb-9756-9eccda253e25 1073741824" returned: 0 in 0.488s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-355f9fee-2868-45fb-9756-9eccda253e25 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:33 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-355f9fee-2868-45fb-9756-9eccda253e25 Jul 19 17:44:33 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:33 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-355f9fee-2868-45fb-9756-9eccda253e25" returned: 0 in 0.272s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1065223873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6283820f-107a-4a92-bc91-a7425be0498e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781117569e934055a5dd9a7f46b8ee62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:33Z,use_quota=True,user_id='7e837a729e7d490b9345dc47a53d6812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Creating volume 6283820f-107a-4a92-bc91-a7425be0498e {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:33 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:33 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e 1073741824 Jul 19 17:44:33 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd69b48-bd29-46f5-ae6d-e92ea9f5272f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-355f9fee-2868-45fb-9756-9eccda253e25', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486f0664-d705-4596-bb80-ad60a9e69251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:33 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Volume volume-355f9fee-2868-45fb-9756-9eccda253e25 (355f9fee-2868-45fb-9756-9eccda253e25): created successfully Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486f0664-d705-4596-bb80-ad60a9e69251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Flow 'volume_create_manager' (b97ca952-e266-44d8-99df-5cfd39465b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:33 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-020ecd7e-6c04-4032-bd77-e38c6ba71b99 tempest-VolumesTransfersV355Test-1434929086 None] Created volume successfully. Jul 19 17:44:34 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e 1073741824" returned: 0 in 0.559s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-17c2af9e-27e5-4fab-a860-a2d2b24c4776 tempest-VolumesExtendTest-1547047626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:34 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e Jul 19 17:44:34 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:34 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e" returned: 0 in 0.269s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-17c2af9e-27e5-4fab-a860-a2d2b24c4776 tempest-VolumesExtendTest-1547047626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.239s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e539a3-910a-4558-b2c8-e9012628f58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6283820f-107a-4a92-bc91-a7425be0498e', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26e84a6-5a67-4a92-926d-b309f925ac9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d63dcdc-e936-4bb5-af2c-1b8e21842e3b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-17c2af9e-27e5-4fab-a860-a2d2b24c4776 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:34 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Volume volume-6283820f-107a-4a92-bc91-a7425be0498e (6283820f-107a-4a92-bc91-a7425be0498e): created successfully Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26e84a6-5a67-4a92-926d-b309f925ac9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Flow 'volume_create_manager' (da817ce3-66db-4e62-9534-b779e6045be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:34 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-be9da90a-bb68-46fd-b9fa-417b2402155f tempest-SnapshotMetadataTestJSON-686247019 None] Created volume successfully. Jul 19 17:44:34 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 Jul 19 17:44:34 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:35 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:35 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Acquiring lock "cinder-355f9fee-2868-45fb-9756-9eccda253e25-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Lock "cinder-355f9fee-2868-45fb-9756-9eccda253e25-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:35 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-17c2af9e-27e5-4fab-a860-a2d2b24c4776 tempest-VolumesExtendTest-1547047626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96" returned: 0 in 0.524s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-17c2af9e-27e5-4fab-a860-a2d2b24c4776 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 2G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Acquiring lock "cinder-quobyte-355f9fee-2868-45fb-9756-9eccda253e25" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Lock "cinder-quobyte-355f9fee-2868-45fb-9756-9eccda253e25" acquired by "delete_volume" :: waited 0.054s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:35 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-17c2af9e-27e5-4fab-a860-a2d2b24c4776 tempest-VolumesExtendTest-1547047626 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 2G" returned: 0 in 0.254s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-17c2af9e-27e5-4fab-a860-a2d2b24c4776 tempest-VolumesExtendTest-1547047626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.825s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04c3a1b-8b9a-40a8-baed-f8401cfe70c2]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-355f9fee-2868-45fb-9756-9eccda253e25 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.563s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] Creating offline snapshot 797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 of volume 6283820f-107a-4a92-bc91-a7425be0498e {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 28 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa6416b-7088-467d-ab3a-f257b4f61c93]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:35 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-355f9fee-2868-45fb-9756-9eccda253e25 Jul 19 17:44:35 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:35 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-17c2af9e-27e5-4fab-a860-a2d2b24c4776 tempest-VolumesExtendTest-1547047626 None] Extend volume completed successfully. Jul 19 17:44:35 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e Jul 19 17:44:35 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:35 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-355f9fee-2868-45fb-9756-9eccda253e25" returned: 0 in 0.471s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-355f9fee-2868-45fb-9756-9eccda253e25 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:35 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-355f9fee-2868-45fb-9756-9eccda253e25 Jul 19 17:44:35 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:36 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e" returned: 0 in 0.448s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:36 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 1G Jul 19 17:44:36 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:36 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-355f9fee-2868-45fb-9756-9eccda253e25" returned: 0 in 0.310s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Lock "cinder-quobyte-355f9fee-2868-45fb-9756-9eccda253e25" released by "delete_volume" :: held 0.918s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Created reservations ['75c415b3-c1cd-41f1-8b7d-24d4a15b6968', 'e0c9fcb9-7cd5-46fd-83d8-91ad7f27053f', 'f0813799-4668-469d-9b99-c1189d462657', '89caf70c-206a-44b6-ab64-3314f6e1b089'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:36 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:36 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:36 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 1G" returned: 0 in 0.568s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6283820f-107a-4a92-bc91-a7425be0498e -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:36 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6283820f-107a-4a92-bc91-a7425be0498e -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 Jul 19 17:44:36 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:36 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.382s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:36 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Deleted volume successfully. Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-65a7d259-0c00-4482-9faa-e9696c36ec23 tempest-VolumesTransfersV355Test-630089658 None] Lock "cinder-355f9fee-2868-45fb-9756-9eccda253e25-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Acquiring lock "cinder-9e90ab4f-4ce8-46d9-b50a-5f1176707f96-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Lock "cinder-9e90ab4f-4ce8-46d9-b50a-5f1176707f96-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Acquiring lock "cinder-quobyte-9e90ab4f-4ce8-46d9-b50a-5f1176707f96" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Lock "cinder-quobyte-9e90ab4f-4ce8-46d9-b50a-5f1176707f96" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:37 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[af99552a-5465-45df-b350-c9351bc2c3e3]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:37 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6283820f-107a-4a92-bc91-a7425be0498e -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01" returned: 0 in 0.501s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:37 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 is being set with open permissions: ugo+rw Jul 19 17:44:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:37 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 Jul 19 17:44:37 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:37 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 Jul 19 17:44:37 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:37 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01" returned: 0 in 0.377s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:37 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.info Jul 19 17:44:37 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:37 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96" returned: 0 in 0.574s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:37 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96 Jul 19 17:44:37 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:37 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.info" returned: 0 in 0.393s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:37 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.info is being set with open permissions: ugo+rw Jul 19 17:44:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:38 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9e90ab4f-4ce8-46d9-b50a-5f1176707f96" returned: 0 in 0.330s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:38 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.info Jul 19 17:44:38 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Lock "cinder-quobyte-9e90ab4f-4ce8-46d9-b50a-5f1176707f96" released by "delete_volume" :: held 0.974s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:38 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Created reservations ['7dced3f5-4d1b-41f9-bbc0-58de503504cb', '21d8c597-2f6a-474a-9c3f-581c3281f14d', '4ff1a0fa-eb7d-4fa9-81e8-5103f00ea2aa', '46bbc66d-1ee8-4990-8387-48161632d801'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:38 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.info" returned: 0 in 0.339s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:38 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:38 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.814s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:38 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-e6eef0e9-dd4b-480f-b9be-7503eac59742 tempest-SnapshotMetadataTestJSON-686247019 None] Create snapshot completed successfully Jul 19 17:44:38 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.319s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:38 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:38 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Deleted volume successfully. Jul 19 17:44:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0f37703d-84cc-4e44-81a1-d6eb52dfc43b tempest-VolumesExtendTest-1547047626 None] Lock "cinder-9e90ab4f-4ce8-46d9-b50a-5f1176707f96-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Acquiring lock "cinder-797b676e-0fe5-4c9c-b58c-fbfa02eb4f01-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Lock "cinder-797b676e-0fe5-4c9c-b58c-fbfa02eb4f01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Acquiring lock "cinder-quobyte-6283820f-107a-4a92-bc91-a7425be0498e" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Lock "cinder-quobyte-6283820f-107a-4a92-bc91-a7425be0498e" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Acquiring lock "cinder-quobyte-797b676e-0fe5-4c9c-b58c-fbfa02eb4f01" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Lock "cinder-quobyte-797b676e-0fe5-4c9c-b58c-fbfa02eb4f01" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Deleting offline snapshot 797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 of volume 6283820f-107a-4a92-bc91-a7425be0498e {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:44:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] snapshot_file for this snap is: volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:44:39 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9868ae-0fae-41df-9b75-b03f5863645c]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:39 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 Jul 19 17:44:39 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Flow 'volume_create_manager' (5f1a8c90-7642-48c3-a421-931ab113a56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3fb073-5a56-4566-89da-1a8489af73f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3fb073-5a56-4566-89da-1a8489af73f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-154707442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a207b2-209e-45ab-abb4-502b6f881d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fd5e1bf38a4f08806626cddfd7d6ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:40Z,use_quota=True,user_id='5aceecf8f992436fa79e7ec4babb960c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b5bd27-1e85-4760-9b88-f97542dc7503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b5bd27-1e85-4760-9b88-f97542dc7503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c63714-0a60-4c8f-8e9d-20fadc13bf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c63714-0a60-4c8f-8e9d-20fadc13bf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a207b2-209e-45ab-abb4-502b6f881d34', 'volume_name': 'volume-34a207b2-209e-45ab-abb4-502b6f881d34', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0615688-5775-4c1d-a193-25acf78714d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0615688-5775-4c1d-a193-25acf78714d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee4cffa-b030-43ce-9c45-676bca8f48fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:40 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Volume 34a207b2-209e-45ab-abb4-502b6f881d34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a207b2-209e-45ab-abb4-502b6f881d34', 'volume_size': 1} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-154707442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a207b2-209e-45ab-abb4-502b6f881d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fd5e1bf38a4f08806626cddfd7d6ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:40Z,use_quota=True,user_id='5aceecf8f992436fa79e7ec4babb960c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Creating volume 34a207b2-209e-45ab-abb4-502b6f881d34 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:40 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:40 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01" returned: 0 in 0.549s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6283820f-107a-4a92-bc91-a7425be0498e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:44:40 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34 1073741824 Jul 19 17:44:40 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafabde5-5dbc-42f9-bc1f-906966369f9b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:40 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e Jul 19 17:44:40 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:40 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e" returned: 0 in 0.524s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:40 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 Jul 19 17:44:40 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:40 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34 1073741824" returned: 0 in 0.706s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:41 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34 Jul 19 17:44:41 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:41 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01" returned: 0 in 0.500s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:41 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01 Jul 19 17:44:41 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:41 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34" returned: 0 in 0.334s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:41 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:41 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee4cffa-b030-43ce-9c45-676bca8f48fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a207b2-209e-45ab-abb4-502b6f881d34', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:41 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86b992c-eb03-4d3c-917d-c47caccf38a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:41 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Volume volume-34a207b2-209e-45ab-abb4-502b6f881d34 (34a207b2-209e-45ab-abb4-502b6f881d34): created successfully Jul 19 17:44:41 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86b992c-eb03-4d3c-917d-c47caccf38a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:41 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Flow 'volume_create_manager' (5f1a8c90-7642-48c3-a421-931ab113a56f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:41 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a690817e-8fd2-49d6-b64b-68bad4cac197 tempest-VolumesExtendTest-1547047626 None] Created volume successfully. Jul 19 17:44:41 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e.797b676e-0fe5-4c9c-b58c-fbfa02eb4f01" returned: 0 in 0.296s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Lock "cinder-quobyte-797b676e-0fe5-4c9c-b58c-fbfa02eb4f01" released by "_delete_snapshot" :: held 2.057s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Lock "cinder-quobyte-6283820f-107a-4a92-bc91-a7425be0498e" released by "delete_snapshot" :: held 2.089s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:41 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Created reservations ['d6b1cd3a-97e5-426e-9b5c-82be32bc439d', '6ad62261-4d95-4211-a2ec-207a3ac4f8a8', 'ebfb428a-4378-4644-b665-42bdfdff62f5', 'b7369b13-6608-4c89-a80f-0d71f66f0810'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:41 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Delete snapshot completed successfully. Jul 19 17:44:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ae5f7829-b5c5-41f2-8304-cf4ae32a5ebd tempest-SnapshotMetadataTestJSON-686247019 None] Lock "cinder-797b676e-0fe5-4c9c-b58c-fbfa02eb4f01-delete_snapshot" released by "delete_snapshot" :: held 2.278s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] Creating offline snapshot cf0341c3-2644-4196-b389-d2949fea9a78 of volume 34a207b2-209e-45ab-abb4-502b6f881d34 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:44:42 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cefe1cf-95f6-452d-ae9d-08d4a78a7a3a]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:42 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34 Jul 19 17:44:42 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:42 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34" returned: 0 in 0.470s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:42 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 1G Jul 19 17:44:42 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Acquiring lock "cinder-6283820f-107a-4a92-bc91-a7425be0498e-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Lock "cinder-6283820f-107a-4a92-bc91-a7425be0498e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Acquiring lock "cinder-quobyte-6283820f-107a-4a92-bc91-a7425be0498e" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:43 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Lock "cinder-quobyte-6283820f-107a-4a92-bc91-a7425be0498e" acquired by "delete_volume" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:43 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35de075-dcca-4f96-8914-6d1f14990c75]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:43 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e Jul 19 17:44:43 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:43 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 1G" returned: 0 in 0.614s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34a207b2-209e-45ab-abb4-502b6f881d34 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:43 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34a207b2-209e-45ab-abb4-502b6f881d34 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 Jul 19 17:44:43 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:43 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e" returned: 0 in 0.530s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:43 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e Jul 19 17:44:43 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:43 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34a207b2-209e-45ab-abb4-502b6f881d34 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78" returned: 0 in 0.415s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:43 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 is being set with open permissions: ugo+rw Jul 19 17:44:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:43 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 Jul 19 17:44:43 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:44 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6283820f-107a-4a92-bc91-a7425be0498e" returned: 0 in 0.432s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Lock "cinder-quobyte-6283820f-107a-4a92-bc91-a7425be0498e" released by "delete_volume" :: held 1.049s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Created reservations ['54f2c1ca-2df8-4c13-a647-1be560cfa529', 'a623ec0f-bae9-4563-9088-bf1b365b6457', 'e5ed2070-ab84-4775-98fb-10e5855ed742', 'a16ef64c-8eb7-4cc7-b60a-21c362b0d9eb'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:44 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78" returned: 0 in 0.323s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:44 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:44 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:44 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.info Jul 19 17:44:44 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:44 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.303s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:44 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Deleted volume successfully. Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2e1a7ac6-9e39-4145-80ff-b6860393c156 tempest-SnapshotMetadataTestJSON-686247019 None] Lock "cinder-6283820f-107a-4a92-bc91-a7425be0498e-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:44 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.info" returned: 0 in 0.292s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:44 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.info is being set with open permissions: ugo+rw Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:44 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.info Jul 19 17:44:44 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:44 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.info" returned: 0 in 0.264s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.493s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:44 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b4458d70-c499-41e4-88df-82bd64b6a840 tempest-VolumesExtendTest-1547047626 None] Create snapshot completed successfully Jul 19 17:44:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dbc40567-3d7c-462b-b004-03ce3954bcb7 tempest-VolumesExtendTest-1547047626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dbc40567-3d7c-462b-b004-03ce3954bcb7 tempest-VolumesExtendTest-1547047626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:45 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa152650-1b9a-4d49-8281-eb77b3bef3ce]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dbc40567-3d7c-462b-b004-03ce3954bcb7 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:45 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34 Jul 19 17:44:45 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:46 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dbc40567-3d7c-462b-b004-03ce3954bcb7 tempest-VolumesExtendTest-1547047626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34" returned: 0 in 0.426s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dbc40567-3d7c-462b-b004-03ce3954bcb7 tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 2G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dbc40567-3d7c-462b-b004-03ce3954bcb7 tempest-VolumesExtendTest-1547047626 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 2G" returned: 0 in 0.161s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dbc40567-3d7c-462b-b004-03ce3954bcb7 tempest-VolumesExtendTest-1547047626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.632s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:46 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-dbc40567-3d7c-462b-b004-03ce3954bcb7 tempest-VolumesExtendTest-1547047626 None] Extend volume completed successfully. Jul 19 17:44:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Acquiring lock "cinder-cf0341c3-2644-4196-b389-d2949fea9a78-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Lock "cinder-cf0341c3-2644-4196-b389-d2949fea9a78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Acquiring lock "cinder-quobyte-34a207b2-209e-45ab-abb4-502b6f881d34" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Lock "cinder-quobyte-34a207b2-209e-45ab-abb4-502b6f881d34" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Acquiring lock "cinder-quobyte-cf0341c3-2644-4196-b389-d2949fea9a78" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Lock "cinder-quobyte-cf0341c3-2644-4196-b389-d2949fea9a78" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Deleting offline snapshot cf0341c3-2644-4196-b389-d2949fea9a78 of volume 34a207b2-209e-45ab-abb4-502b6f881d34 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:44:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] snapshot_file for this snap is: volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:44:47 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f983c2b-e6a1-4f85-85ae-7723521964bb]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:47 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 Jul 19 17:44:47 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:47 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78" returned: 0 in 0.446s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34a207b2-209e-45ab-abb4-502b6f881d34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:44:47 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[15633697-3ade-47b0-9ea4-f4a816394690]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:47 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34 Jul 19 17:44:47 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:48 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34" returned: 0 in 0.665s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:48 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 Jul 19 17:44:48 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:48 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78" returned: 0 in 0.577s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:48 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78 Jul 19 17:44:48 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Flow 'volume_create_manager' (a64553f5-8e76-424a-a20e-28f170218166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713014ab-33b2-4a04-9070-ee39375d50b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713014ab-33b2-4a04-9070-ee39375d50b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2132852266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db794569-988a-425c-8452-99065e863913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956ae8aef465462f8d006cd9be64bd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:49Z,use_quota=True,user_id='ad363c43cb604595866ec66f5f7ffbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:49 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd07afb4-41d5-4906-a6be-d0dca44f5d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd07afb4-41d5-4906-a6be-d0dca44f5d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f49fd15-6555-4ebc-b1b7-32f111795b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f49fd15-6555-4ebc-b1b7-32f111795b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db794569-988a-425c-8452-99065e863913', 'volume_name': 'volume-db794569-988a-425c-8452-99065e863913', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d74f9d-4b9a-4fe9-b974-ea704f25cf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d74f9d-4b9a-4fe9-b974-ea704f25cf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2a9580-91bc-4d10-a9f9-df4ea1d116d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:49 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Volume db794569-988a-425c-8452-99065e863913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db794569-988a-425c-8452-99065e863913', 'volume_size': 1} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2132852266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db794569-988a-425c-8452-99065e863913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956ae8aef465462f8d006cd9be64bd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:49Z,use_quota=True,user_id='ad363c43cb604595866ec66f5f7ffbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Creating volume db794569-988a-425c-8452-99065e863913 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:49 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-db794569-988a-425c-8452-99065e863913 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34.cf0341c3-2644-4196-b389-d2949fea9a78" returned: 0 in 0.460s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:49 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-db794569-988a-425c-8452-99065e863913 1073741824 Jul 19 17:44:49 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Lock "cinder-quobyte-cf0341c3-2644-4196-b389-d2949fea9a78" released by "_delete_snapshot" :: held 2.283s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Lock "cinder-quobyte-34a207b2-209e-45ab-abb4-502b6f881d34" released by "delete_snapshot" :: held 2.312s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Created reservations ['42dc1bf8-c8c1-4442-a18b-e27b330b41d0', 'fceba6fa-dd38-4642-8da3-48d0c32f17b0', '16995584-4209-4732-a4a0-147e1c5c8bda', '67829a6e-404f-4b2b-8508-0f5eff6607ab'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Flow 'volume_create_manager' (6f0094fc-c6c3-4230-bfcc-eb9042413086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb1882b-9cc0-43fd-a724-7b6164317a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb1882b-9cc0-43fd-a724-7b6164317a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-663957217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ba86c3-cc44-43a6-adf2-45cacf6b8089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3dcae6b2a64c9cb1faa3f6529f423e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:49Z,use_quota=True,user_id='9e01cd6d42224b4697531e9dfdb1d7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7eb6d4-e611-47bc-9ab9-35cbd6003ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7eb6d4-e611-47bc-9ab9-35cbd6003ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b986c8ef-004c-49c7-83b7-054f8c6c8290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b986c8ef-004c-49c7-83b7-054f8c6c8290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ba86c3-cc44-43a6-adf2-45cacf6b8089', 'volume_name': 'volume-15ba86c3-cc44-43a6-adf2-45cacf6b8089', 'volume_size': 2}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005c6ab0-d00b-4186-8278-f450458775f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005c6ab0-d00b-4186-8278-f450458775f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64cbbbf8-7c38-4764-b25e-cde206840312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:49 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Volume 15ba86c3-cc44-43a6-adf2-45cacf6b8089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ba86c3-cc44-43a6-adf2-45cacf6b8089', 'volume_size': 2} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:49 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Delete snapshot completed successfully. Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c307065b-c4ce-4d7c-9295-af0c7b6f960f tempest-VolumesExtendTest-1547047626 None] Lock "cinder-cf0341c3-2644-4196-b389-d2949fea9a78-delete_snapshot" released by "delete_snapshot" :: held 2.582s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:49 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-db794569-988a-425c-8452-99065e863913 1073741824" returned: 0 in 0.535s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-db794569-988a-425c-8452-99065e863913 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:49 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-db794569-988a-425c-8452-99065e863913 Jul 19 17:44:49 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:50 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-db794569-988a-425c-8452-99065e863913" returned: 0 in 0.252s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.558s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-663957217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ba86c3-cc44-43a6-adf2-45cacf6b8089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3dcae6b2a64c9cb1faa3f6529f423e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:49Z,use_quota=True,user_id='9e01cd6d42224b4697531e9dfdb1d7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Creating volume 15ba86c3-cc44-43a6-adf2-45cacf6b8089 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:50 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-15ba86c3-cc44-43a6-adf2-45cacf6b8089 2147483648 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2a9580-91bc-4d10-a9f9-df4ea1d116d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db794569-988a-425c-8452-99065e863913', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71664f79-d1d8-4c07-8ed7-08a2a9018df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:50 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-15ba86c3-cc44-43a6-adf2-45cacf6b8089 2147483648 Jul 19 17:44:50 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:50 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Volume volume-db794569-988a-425c-8452-99065e863913 (db794569-988a-425c-8452-99065e863913): created successfully Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71664f79-d1d8-4c07-8ed7-08a2a9018df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Flow 'volume_create_manager' (a64553f5-8e76-424a-a20e-28f170218166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:50 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-7106beea-dcd3-41dc-b2e7-e84e003ff600 tempest-VolumesNegativeTest-73819055 None] Created volume successfully. Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Acquiring lock "cinder-34a207b2-209e-45ab-abb4-502b6f881d34-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Lock "cinder-34a207b2-209e-45ab-abb4-502b6f881d34-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Acquiring lock "cinder-quobyte-34a207b2-209e-45ab-abb4-502b6f881d34" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Lock "cinder-quobyte-34a207b2-209e-45ab-abb4-502b6f881d34" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63bd896-a9ef-4257-b4be-9ea86e617f27]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:50 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34 Jul 19 17:44:50 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:50 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-15ba86c3-cc44-43a6-adf2-45cacf6b8089 2147483648" returned: 0 in 0.697s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-15ba86c3-cc44-43a6-adf2-45cacf6b8089 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:50 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-15ba86c3-cc44-43a6-adf2-45cacf6b8089 Jul 19 17:44:50 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:51 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34" returned: 0 in 0.523s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:51 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34 Jul 19 17:44:51 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:51 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-15ba86c3-cc44-43a6-adf2-45cacf6b8089" returned: 0 in 0.318s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64cbbbf8-7c38-4764-b25e-cde206840312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ba86c3-cc44-43a6-adf2-45cacf6b8089', 'volume_size': 2}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3ab223-ee97-4627-9c76-b723499f020a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:51 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Volume volume-15ba86c3-cc44-43a6-adf2-45cacf6b8089 (15ba86c3-cc44-43a6-adf2-45cacf6b8089): created successfully Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3ab223-ee97-4627-9c76-b723499f020a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Flow 'volume_create_manager' (6f0094fc-c6c3-4230-bfcc-eb9042413086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:51 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-66777ecd-5522-4b9b-9937-f4ffd28bdd54 tempest-VolumesCloneNegativeTest-2034780969 None] Created volume successfully. Jul 19 17:44:51 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-34a207b2-209e-45ab-abb4-502b6f881d34" returned: 0 in 0.332s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Lock "cinder-quobyte-34a207b2-209e-45ab-abb4-502b6f881d34" released by "delete_volume" :: held 0.942s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Created reservations ['1f13c699-de20-47e2-bdea-cc0ccf24e72d', 'b5a4fe8a-91db-4695-b5d5-21036c71fd4f', 'a83a7160-90f8-4a1e-9da9-b726b3f1572c', '9fd3a627-c471-4878-971d-bff8910c75e4'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:51 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:51 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Acquiring lock "cinder-15ba86c3-cc44-43a6-adf2-45cacf6b8089-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Lock "cinder-15ba86c3-cc44-43a6-adf2-45cacf6b8089-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:52 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.309s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:52 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Acquiring lock "cinder-quobyte-15ba86c3-cc44-43a6-adf2-45cacf6b8089" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:44:52 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Deleted volume successfully. Jul 19 17:44:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Lock "cinder-quobyte-15ba86c3-cc44-43a6-adf2-45cacf6b8089" acquired by "delete_volume" :: waited 0.031s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:44:52 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc20467-5411-4d25-bca4-5b90094b6e43]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:44:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-15ba86c3-cc44-43a6-adf2-45cacf6b8089 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2a04d121-b464-49e1-803d-154faca427ce tempest-VolumesExtendTest-1547047626 None] Lock "cinder-34a207b2-209e-45ab-abb4-502b6f881d34-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:52 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-15ba86c3-cc44-43a6-adf2-45cacf6b8089 Jul 19 17:44:52 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:52 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-15ba86c3-cc44-43a6-adf2-45cacf6b8089" returned: 0 in 0.418s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-15ba86c3-cc44-43a6-adf2-45cacf6b8089 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:52 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-15ba86c3-cc44-43a6-adf2-45cacf6b8089 Jul 19 17:44:52 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:52 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-15ba86c3-cc44-43a6-adf2-45cacf6b8089" returned: 0 in 0.328s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Lock "cinder-quobyte-15ba86c3-cc44-43a6-adf2-45cacf6b8089" released by "delete_volume" :: held 0.827s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:53 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Created reservations ['a592e97c-4e30-443f-b66b-18587bdace4b', 'bd7cfa16-e0d4-4bdb-9142-3ad01a57f13d', 'a4ccecd3-5d06-4ac5-8681-5dca1016fd81', '6eb72059-6814-4938-9a57-1e1b16cef2c3'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:44:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:53 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:44:53 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:53 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.340s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:53 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:44:53 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Deleted volume successfully. Jul 19 17:44:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b5bed6b9-bcc6-4dff-8502-397444298a37 tempest-VolumesCloneNegativeTest-2034780969 None] Lock "cinder-15ba86c3-cc44-43a6-adf2-45cacf6b8089-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=146,cinder:UPDATE=205,cinder:INSERT=57,cinder:DELETE=16 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:UPDATE=189,cinder:SELECT=138,cinder:INSERT=46,cinder:DELETE=18 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Flow 'volume_create_manager' (2bdd480a-bd1d-44d4-a31f-d6842530da8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b40178-9a3a-489d-9fb9-04157cfdb599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b40178-9a3a-489d-9fb9-04157cfdb599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-699137680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113403d8-00a1-4a5d-b71f-8fda36a4b5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08b069cb808422db47ed61873ea42ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:58Z,use_quota=True,user_id='9d4bc2ad05d74c0c810d96cdf5a969ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497e311c-aab7-4b22-b8c3-5a5c1b324895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497e311c-aab7-4b22-b8c3-5a5c1b324895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96de33c4-37ed-4614-bf4c-798d6fb2598a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96de33c4-37ed-4614-bf4c-798d6fb2598a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '113403d8-00a1-4a5d-b71f-8fda36a4b5c4', 'volume_name': 'volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9aba4ac-f602-4257-a43a-3be6d512973b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9aba4ac-f602-4257-a43a-3be6d512973b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d83c387-5b76-4f3e-86a7-734c561a7e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:58 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Volume 113403d8-00a1-4a5d-b71f-8fda36a4b5c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4', 'volume_size': 1} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-699137680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113403d8-00a1-4a5d-b71f-8fda36a4b5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08b069cb808422db47ed61873ea42ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:58Z,use_quota=True,user_id='9d4bc2ad05d74c0c810d96cdf5a969ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Creating volume 113403d8-00a1-4a5d-b71f-8fda36a4b5c4 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:58 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:58 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 1073741824 Jul 19 17:44:58 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Flow 'volume_create_manager' (6b1e252c-3e44-45cd-900d-4570e5b2a0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (409e0809-2415-4e2a-ac60-f4dff7c7dcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (409e0809-2415-4e2a-ac60-f4dff7c7dcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1005441018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42378193-f322-49bb-ac56-552ceea6565d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9243001ff97e4f5d83ee80da8e7bba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:59Z,use_quota=True,user_id='a368301f719b47a3b9387a1ffba10b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1af33ee-cd03-4ccd-89bd-d92c62fb25fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1af33ee-cd03-4ccd-89bd-d92c62fb25fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0d38f7-32a5-4aa9-a698-404536e8402e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0d38f7-32a5-4aa9-a698-404536e8402e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42378193-f322-49bb-ac56-552ceea6565d', 'volume_name': 'volume-42378193-f322-49bb-ac56-552ceea6565d', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f94861-6938-4757-985f-6691bc2c38a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f94861-6938-4757-985f-6691bc2c38a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1960184-99b7-4ea1-9ad4-b56158154f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:59 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Volume 42378193-f322-49bb-ac56-552ceea6565d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42378193-f322-49bb-ac56-552ceea6565d', 'volume_size': 1} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:59 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 1073741824" returned: 0 in 0.602s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:59 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 Jul 19 17:44:59 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:59 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" returned: 0 in 0.277s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1005441018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42378193-f322-49bb-ac56-552ceea6565d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9243001ff97e4f5d83ee80da8e7bba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:44:59Z,use_quota=True,user_id='a368301f719b47a3b9387a1ffba10b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Creating volume 42378193-f322-49bb-ac56-552ceea6565d {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:44:59 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-42378193-f322-49bb-ac56-552ceea6565d 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:44:59 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-42378193-f322-49bb-ac56-552ceea6565d 1073741824 Jul 19 17:44:59 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d83c387-5b76-4f3e-86a7-734c561a7e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650e2548-0c6b-4eb2-915d-239b5b2ddd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:44:59 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Volume volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 (113403d8-00a1-4a5d-b71f-8fda36a4b5c4): created successfully Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650e2548-0c6b-4eb2-915d-239b5b2ddd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:44:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Flow 'volume_create_manager' (2bdd480a-bd1d-44d4-a31f-d6842530da8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:44:59 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-50b1b139-38a7-4b59-b0a6-04f1b94eb846 tempest-VolumesSnapshotListTestJSON-1943658479 None] Created volume successfully. Jul 19 17:45:00 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-42378193-f322-49bb-ac56-552ceea6565d 1073741824" returned: 0 in 0.778s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-42378193-f322-49bb-ac56-552ceea6565d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:00 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-42378193-f322-49bb-ac56-552ceea6565d Jul 19 17:45:00 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:00 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-42378193-f322-49bb-ac56-552ceea6565d" returned: 0 in 0.385s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:45:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1960184-99b7-4ea1-9ad4-b56158154f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42378193-f322-49bb-ac56-552ceea6565d', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d757c7-f9a9-42db-9055-d9cf00af8d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:00 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Volume volume-42378193-f322-49bb-ac56-552ceea6565d (42378193-f322-49bb-ac56-552ceea6565d): created successfully Jul 19 17:45:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d757c7-f9a9-42db-9055-d9cf00af8d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Flow 'volume_create_manager' (6b1e252c-3e44-45cd-900d-4570e5b2a0d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:00 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-4f51cc53-1b21-4a59-a2b5-85d4299263c8 tempest-VolumesGetTest-283534734 None] Created volume successfully. Jul 19 17:45:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Creating offline snapshot 4022d23f-d777-43d8-9dd3-ea4d3c490760 of volume 113403d8-00a1-4a5d-b71f-8fda36a4b5c4 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:45:01 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b88b2fa-b4c0-4430-bee0-72be35a3a2b6]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:01 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 Jul 19 17:45:01 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:01 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:45:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Flow 'volume_create_manager' (b7b77243-4d4c-4c4b-aed8-8a0228636dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d379bf61-4f77-47f1-bb11-5ac895242d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d379bf61-4f77-47f1-bb11-5ac895242d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1547300459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f41603-daba-4e6c-84b2-0f46dfac4e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f69569c1a9c4242917a24f0d8dbe9b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:01Z,use_quota=True,user_id='be2d53c71a304b97b25887865fbea75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac9c83e-ffa9-46e7-b76e-7bff6e8eaa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac9c83e-ffa9-46e7-b76e-7bff6e8eaa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a737e2a-f954-494a-96c7-d4d1cb38f0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:01 devstack cinder-volume[87676]: DEBUG cinder.image.glance [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Creating Keystone auth plugin from conf {{(pid=87676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 17:45:01 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" returned: 0 in 0.557s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:01 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 1G Jul 19 17:45:01 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a737e2a-f954-494a-96c7-d4d1cb38f0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '44f41603-daba-4e6c-84b2-0f46dfac4e89', 'volume_name': 'volume-44f41603-daba-4e6c-84b2-0f46dfac4e89', 'volume_size': 1, 'image_id': '3f690ae5-6466-476d-bb48-a634301656d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b6bd91692f74fd082fc706a6071a464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3f690ae5-6466-476d-bb48-a634301656d0', 'created_at': datetime.datetime(2026, 7, 19, 15, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 29, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f690ae5-6466-476d-bb48-a634301656d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8b96c8-8e46-458f-b5f0-d1ab2ab09962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8b96c8-8e46-458f-b5f0-d1ab2ab09962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8313d521-d0ce-4067-b05c-ac65c447139c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:02 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Volume 44f41603-daba-4e6c-84b2-0f46dfac4e89: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-44f41603-daba-4e6c-84b2-0f46dfac4e89', 'volume_size': 1, 'image_id': '3f690ae5-6466-476d-bb48-a634301656d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b6bd91692f74fd082fc706a6071a464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3f690ae5-6466-476d-bb48-a634301656d0', 'created_at': datetime.datetime(2026, 7, 19, 15, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 29, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f690ae5-6466-476d-bb48-a634301656d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 19 17:45:02 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Trying to clone 44f41603-daba-4e6c-84b2-0f46dfac4e89 from image 3f690ae5-6466-476d-bb48-a634301656d0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}]). {{(pid=87676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 17:45:02 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 1G" returned: 0 in 1.008s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:02 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 Jul 19 17:45:02 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:02 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:45:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Flow 'volume_create_manager' (4555f1da-7ba7-4034-809c-fc5291d8c66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (253e6b6c-9f58-48fc-9f60-06a559324016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (253e6b6c-9f58-48fc-9f60-06a559324016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-971922074',display_name='tempest-VolumesGetTest-Volume-1303592477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9243001ff97e4f5d83ee80da8e7bba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:03Z,use_quota=True,user_id='a368301f719b47a3b9387a1ffba10b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e99482-beb4-4e53-b089-a6f9335d7888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e99482-beb4-4e53-b089-a6f9335d7888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f1f8a6-e278-4d50-9004-e1449f176ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f1f8a6-e278-4d50-9004-e1449f176ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a', 'volume_name': 'volume-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb35f25a-c656-435e-a715-b821bcdde1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb35f25a-c656-435e-a715-b821bcdde1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543cbbca-d908-4c5a-8eca-46b07c365c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:03 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Volume 5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a', 'volume_size': 1} Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_i16h8gipdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 17:45:03 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Image download 20.69 MB at 20.69 MB/s Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b548cd-c089-4fba-b90f-1d85f2e93cf6]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_i16h8gipdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:03 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760" returned: 0 in 0.605s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:03 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 is being set with open permissions: ugo+rw Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:03 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_i16h8gipdevstack@QuobyteHD Jul 19 17:45:03 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:03 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 Jul 19 17:45:03 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:03 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_i16h8gipdevstack@QuobyteHD" returned: 0 in 0.495s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Temporary image 3f690ae5-6466-476d-bb48-a634301656d0 is fetched for user be2d53c71a304b97b25887865fbea75e. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 17:45:03 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760" returned: 0 in 0.443s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd22e59-6f2f-4fa9-98d9-9d463ab060b5]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_i16h8gipdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:03 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.info Jul 19 17:45:03 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:04 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_i16h8gipdevstack@QuobyteHD Jul 19 17:45:04 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:04 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.info" returned: 0 in 0.417s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:04 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.info is being set with open permissions: ugo+rw Jul 19 17:45:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:04 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.info Jul 19 17:45:04 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:04 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_i16h8gipdevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:04 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.info" returned: 0 in 0.299s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.489s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.513s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-971922074',display_name='tempest-VolumesGetTest-Volume-1303592477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9243001ff97e4f5d83ee80da8e7bba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:03Z,use_quota=True,user_id='a368301f719b47a3b9387a1ffba10b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:45:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Creating volume 5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:45:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:45:04 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:45:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:04 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a 1073741824 Jul 19 17:45:04 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-faf0e903-b213-4835-a6e7-35df6fd97bf2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Create snapshot completed successfully Jul 19 17:45:04 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:05 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a 1073741824" returned: 0 in 0.573s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:05 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a Jul 19 17:45:05 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:05 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a" returned: 0 in 0.278s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.163s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1547300459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f41603-daba-4e6c-84b2-0f46dfac4e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f69569c1a9c4242917a24f0d8dbe9b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:01Z,use_quota=True,user_id='be2d53c71a304b97b25887865fbea75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Creating volume 44f41603-daba-4e6c-84b2-0f46dfac4e89 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:45:05 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:05 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89 1073741824 Jul 19 17:45:05 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543cbbca-d908-4c5a-8eca-46b07c365c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0419bb-2fc1-47e0-bfab-5c5704011933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:05 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Volume volume-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a (5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a): created successfully Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0419bb-2fc1-47e0-bfab-5c5704011933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Flow 'volume_create_manager' (4555f1da-7ba7-4034-809c-fc5291d8c66c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f2a5fc78-e03d-4919-a2f0-ed2221bcae46 tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:05 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-991c5949-5597-4763-aaea-1fdee146d483 tempest-VolumesGetTest-283534734 None] Created volume successfully. Jul 19 17:45:05 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89 1073741824" returned: 0 in 0.439s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:06 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89 Jul 19 17:45:06 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Acquiring lock "cinder-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Lock "cinder-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Acquiring lock "cinder-quobyte-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a" acquired by "delete_volume" :: waited 0.015s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c598a0-a9cd-42cf-9426-d2266c2d7dfe]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:06 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89" returned: 0 in 0.275s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f2a5fc78-e03d-4919-a2f0-ed2221bcae46 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.665s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f2a5fc78-e03d-4919-a2f0-ed2221bcae46 tempest-VolumesSnapshotListTestJSON-1943658479 None] Creating offline snapshot 0612e65b-f359-4737-8de8-3128b116ff61 of volume 113403d8-00a1-4a5d-b71f-8fda36a4b5c4 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:45:06 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a Jul 19 17:45:06 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Attempting download of 3f690ae5-6466-476d-bb48-a634301656d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}])) to volume 44f41603-daba-4e6c-84b2-0f46dfac4e89. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[35af4e1f-50d6-48a3-80d5-3f548c10e809]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f2a5fc78-e03d-4919-a2f0-ed2221bcae46 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[888e8b16-570f-40f8-a324-ecd2bb714ba5]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_czd7a0i1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:06 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 Jul 19 17:45:06 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:06 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_czd7a0i1 Jul 19 17:45:06 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:06 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a" returned: 0 in 0.411s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:06 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a Jul 19 17:45:06 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:06 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f2a5fc78-e03d-4919-a2f0-ed2221bcae46 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760" returned: 0 in 0.448s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f2a5fc78-e03d-4919-a2f0-ed2221bcae46 tempest-VolumesSnapshotListTestJSON-1943658479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f2a5fc78-e03d-4919-a2f0-ed2221bcae46 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:06 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_czd7a0i1" returned: 0 in 0.416s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_czd7a0i1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:06 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 1G Jul 19 17:45:06 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:06 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a" returned: 0 in 0.294s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a" released by "delete_volume" :: held 0.761s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:06 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_czd7a0i1 Jul 19 17:45:06 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Created reservations ['8207e1eb-2285-47a3-9b96-6660901222ce', '107a922c-e87d-4a35-b08e-7666edf34ed9', 'a6e28db3-b9e8-4d81-8e8d-9ca35a188529', 'f47d3906-d23b-4857-a9db-05ce25a3d377'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:07 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:45:07 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:07 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_czd7a0i1" returned: 1 in 0.386s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_czd7a0i1' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5142f029-67fd-4ccd-9715-e1c60421377e]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_i16h8gipdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:07 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_i16h8gipdevstack@QuobyteHD Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Acquiring lock "cinder-42378193-f322-49bb-ac56-552ceea6565d-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:07 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:07 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.352s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:45:07 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f2a5fc78-e03d-4919-a2f0-ed2221bcae46 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 1G" returned: 0 in 0.603s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f2a5fc78-e03d-4919-a2f0-ed2221bcae46 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Lock "cinder-42378193-f322-49bb-ac56-552ceea6565d-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:07 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Deleted volume successfully. Jul 19 17:45:07 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 Jul 19 17:45:07 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-282a5ede-037d-45ca-a741-f6abb41f6a66 tempest-VolumesGetTest-283534734 None] Lock "cinder-5d11a4da-ee3f-47bb-aec8-be1e7b2ade4a-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Acquiring lock "cinder-quobyte-42378193-f322-49bb-ac56-552ceea6565d" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-42378193-f322-49bb-ac56-552ceea6565d" acquired by "delete_volume" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f719d5-459d-4d83-a167-94379ee8cc2c]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-42378193-f322-49bb-ac56-552ceea6565d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:07 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_i16h8gipdevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] 3f690ae5-6466-476d-bb48-a634301656d0 was qcow2, converting to qcow2 {{(pid=87676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_i16h8gipdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:07 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-42378193-f322-49bb-ac56-552ceea6565d Jul 19 17:45:07 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:07 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_i16h8gipdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89 Jul 19 17:45:07 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:07 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f2a5fc78-e03d-4919-a2f0-ed2221bcae46 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61" returned: 0 in 0.416s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:07 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-f2a5fc78-e03d-4919-a2f0-ed2221bcae46 tempest-VolumesSnapshotListTestJSON-1943658479 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 is being set with open permissions: ugo+rw Jul 19 17:45:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f2a5fc78-e03d-4919-a2f0-ed2221bcae46 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:07 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 Jul 19 17:45:07 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:08 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-42378193-f322-49bb-ac56-552ceea6565d" returned: 0 in 0.487s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-42378193-f322-49bb-ac56-552ceea6565d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:08 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-42378193-f322-49bb-ac56-552ceea6565d Jul 19 17:45:08 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:08 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f2a5fc78-e03d-4919-a2f0-ed2221bcae46 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61" returned: 0 in 0.287s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f2a5fc78-e03d-4919-a2f0-ed2221bcae46 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.892s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:08 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f2a5fc78-e03d-4919-a2f0-ed2221bcae46 tempest-VolumesSnapshotListTestJSON-1943658479 None] Create snapshot completed successfully Jul 19 17:45:08 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-42378193-f322-49bb-ac56-552ceea6565d" returned: 0 in 0.288s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-42378193-f322-49bb-ac56-552ceea6565d" released by "delete_volume" :: held 0.824s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:08 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Created reservations ['467be66a-8da0-4022-8cea-3b1c6dad6a02', '985f7d35-ec5e-4d98-bfcc-d97fffb3e8dd', '6b14eeb3-af9e-44e6-9309-9983199226b5', '8b6d7947-2e26-4668-947d-5d9c9f33668a'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:45:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:08 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:45:08 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:08 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.321s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:08 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:45:08 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Deleted volume successfully. Jul 19 17:45:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ddb40436-7fa2-4333-bfc8-bb199f3a7ee8 tempest-VolumesGetTest-283534734 None] Lock "cinder-42378193-f322-49bb-ac56-552ceea6565d-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e5390271-e787-48ef-add0-36928e770f6f tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e5390271-e787-48ef-add0-36928e770f6f tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-e5390271-e787-48ef-add0-36928e770f6f tempest-VolumesSnapshotListTestJSON-1943658479 None] Creating offline snapshot a95e60a3-1ec4-43f1-8415-40e88d417c03 of volume 113403d8-00a1-4a5d-b71f-8fda36a4b5c4 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f76ba6-3126-4a62-aaf5-69d35c59071d]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5390271-e787-48ef-add0-36928e770f6f tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Flow 'volume_create_manager' (88da5160-ef25-4060-96f6-317f278ff06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a043697-6083-4d43-ba19-2335dc78b683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a043697-6083-4d43-ba19-2335dc78b683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1032727018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d7da4a-9de0-49b1-911a-8682a8708656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9243001ff97e4f5d83ee80da8e7bba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:09Z,use_quota=True,user_id='a368301f719b47a3b9387a1ffba10b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3becc92-76d3-4a4b-ab55-dc025f6ae921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3becc92-76d3-4a4b-ab55-dc025f6ae921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef6e36c-bd0a-4db0-8fd5-30d7134a0a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef6e36c-bd0a-4db0-8fd5-30d7134a0a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d7da4a-9de0-49b1-911a-8682a8708656', 'volume_name': 'volume-75d7da4a-9de0-49b1-911a-8682a8708656', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cab1048-296d-4b15-ab18-ab0af76fbb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cab1048-296d-4b15-ab18-ab0af76fbb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6814b00f-578d-4998-9b83-2f24aa388c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:09 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Volume 75d7da4a-9de0-49b1-911a-8682a8708656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d7da4a-9de0-49b1-911a-8682a8708656', 'volume_size': 1} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:09 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 Jul 19 17:45:09 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:09 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5390271-e787-48ef-add0-36928e770f6f tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61" returned: 0 in 0.454s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-e5390271-e787-48ef-add0-36928e770f6f tempest-VolumesSnapshotListTestJSON-1943658479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5390271-e787-48ef-add0-36928e770f6f tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:09 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_i16h8gipdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89" returned: 0 in 2.168s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_i16h8gipdevstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:45:09 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Converted 112.00 MB image at 51.60 MB/s Jul 19 17:45:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:09 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03 1G Jul 19 17:45:09 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:09 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89 1G Jul 19 17:45:09 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:10 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89 1G" returned: 0 in 0.350s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Downloaded image 3f690ae5-6466-476d-bb48-a634301656d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}])) to volume 44f41603-daba-4e6c-84b2-0f46dfac4e89 successfully. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Temporary image 3f690ae5-6466-476d-bb48-a634301656d0 for user be2d53c71a304b97b25887865fbea75e is deleted. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Marking volume 44f41603-daba-4e6c-84b2-0f46dfac4e89 as bootable. {{(pid=87676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Copying metadata from image 3f690ae5-6466-476d-bb48-a634301656d0 to 44f41603-daba-4e6c-84b2-0f46dfac4e89. {{(pid=87676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Creating volume glance metadata for volume 44f41603-daba-4e6c-84b2-0f46dfac4e89 backed by image 3f690ae5-6466-476d-bb48-a634301656d0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3f690ae5-6466-476d-bb48-a634301656d0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8313d521-d0ce-4067-b05c-ac65c447139c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44f41603-daba-4e6c-84b2-0f46dfac4e89', 'volume_size': 1, 'image_id': '3f690ae5-6466-476d-bb48-a634301656d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b6bd91692f74fd082fc706a6071a464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3f690ae5-6466-476d-bb48-a634301656d0', 'created_at': datetime.datetime(2026, 7, 19, 15, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 29, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f690ae5-6466-476d-bb48-a634301656d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b99a2b-09c9-4693-b859-ee865b56a1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:10 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Volume volume-44f41603-daba-4e6c-84b2-0f46dfac4e89 (44f41603-daba-4e6c-84b2-0f46dfac4e89): created successfully Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b99a2b-09c9-4693-b859-ee865b56a1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Flow 'volume_create_manager' (b7b77243-4d4c-4c4b-aed8-8a0228636dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:10 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a7dd174e-b8f7-4438-aa3c-d751dcd5043a tempest-TestShelveInstance-126331557 None] Created volume successfully. Jul 19 17:45:10 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5390271-e787-48ef-add0-36928e770f6f tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03 1G" returned: 0 in 0.545s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5390271-e787-48ef-add0-36928e770f6f tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:10 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03 Jul 19 17:45:10 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:10 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5390271-e787-48ef-add0-36928e770f6f tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03" returned: 0 in 0.297s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:10 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-e5390271-e787-48ef-add0-36928e770f6f tempest-VolumesSnapshotListTestJSON-1943658479 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03 is being set with open permissions: ugo+rw Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5390271-e787-48ef-add0-36928e770f6f tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:10 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03 Jul 19 17:45:10 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:10 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5390271-e787-48ef-add0-36928e770f6f tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03" returned: 0 in 0.241s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e5390271-e787-48ef-add0-36928e770f6f tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.651s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.446s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1032727018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d7da4a-9de0-49b1-911a-8682a8708656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9243001ff97e4f5d83ee80da8e7bba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:09Z,use_quota=True,user_id='a368301f719b47a3b9387a1ffba10b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Creating volume 75d7da4a-9de0-49b1-911a-8682a8708656 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:45:11 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:45:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:11 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 1073741824 Jul 19 17:45:11 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:11 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-e5390271-e787-48ef-add0-36928e770f6f tempest-VolumesSnapshotListTestJSON-1943658479 None] Create snapshot completed successfully Jul 19 17:45:11 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 1073741824" returned: 0 in 0.556s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:11 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 Jul 19 17:45:11 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:11 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656" returned: 0 in 0.328s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:45:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6814b00f-578d-4998-9b83-2f24aa388c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d7da4a-9de0-49b1-911a-8682a8708656', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c21f23-297d-496a-a102-938122532916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:11 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Volume volume-75d7da4a-9de0-49b1-911a-8682a8708656 (75d7da4a-9de0-49b1-911a-8682a8708656): created successfully Jul 19 17:45:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c21f23-297d-496a-a102-938122532916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:12 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Flow 'volume_create_manager' (88da5160-ef25-4060-96f6-317f278ff06c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:12 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f1dc3c5e-a36b-419d-8eb4-a0aede6a6a7d tempest-VolumesGetTest-283534734 None] Created volume successfully. Jul 19 17:45:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "cinder-a95e60a3-1ec4-43f1-8415-40e88d417c03-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-a95e60a3-1ec4-43f1-8415-40e88d417c03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "cinder-quobyte-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-quobyte-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "cinder-quobyte-a95e60a3-1ec4-43f1-8415-40e88d417c03" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-quobyte-a95e60a3-1ec4-43f1-8415-40e88d417c03" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Deleting offline snapshot a95e60a3-1ec4-43f1-8415-40e88d417c03 of volume 113403d8-00a1-4a5d-b71f-8fda36a4b5c4 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:45:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] snapshot_file for this snap is: volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:45:12 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d689de-4996-458e-969b-64a42474f776]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:12 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03 Jul 19 17:45:12 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:12 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03" returned: 0 in 0.517s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:45:12 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[72523e0c-52ec-49c0-b404-15e7ae5c590f]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:12 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 Jul 19 17:45:12 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Flow 'volume_create_manager' (3f872067-eee5-40eb-b456-c12d727a2423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4710b23f-c615-4a74-b945-e743af165a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4710b23f-c615-4a74-b945-e743af165a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2012681925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d8c449-30a0-4623-bb94-73f9a80cd468,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9243001ff97e4f5d83ee80da8e7bba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=75d7da4a-9de0-49b1-911a-8682a8708656,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:13Z,use_quota=True,user_id='a368301f719b47a3b9387a1ffba10b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7286268-3db3-4d1c-8442-6b50de3bc52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7286268-3db3-4d1c-8442-6b50de3bc52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fe11e6-7f7c-4bb5-bd26-fb2891f9616e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fe11e6-7f7c-4bb5-bd26-fb2891f9616e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f1d8c449-30a0-4623-bb94-73f9a80cd468', 'volume_name': 'volume-f1d8c449-30a0-4623-bb94-73f9a80cd468', 'volume_size': 1, 'source_volid': '75d7da4a-9de0-49b1-911a-8682a8708656', 'source_volstatus': 'available'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4ecf30-a49e-4db8-b895-399cadf56fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4ecf30-a49e-4db8-b895-399cadf56fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2635581c-1ecd-48c8-871c-e7ee991974ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:13 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Volume f1d8c449-30a0-4623-bb94-73f9a80cd468: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f1d8c449-30a0-4623-bb94-73f9a80cd468', 'volume_size': 1, 'source_volid': '75d7da4a-9de0-49b1-911a-8682a8708656', 'source_volstatus': 'available'} Jul 19 17:45:13 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61" returned: 0 in 0.629s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:13 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Cloning volume 75d7da4a-9de0-49b1-911a-8682a8708656 to volume f1d8c449-30a0-4623-bb94-73f9a80cd468 Jul 19 17:45:13 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03 Jul 19 17:45:13 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Creating offline snapshot 0dca8b93-c2bf-4492-8cfc-256e7f2f420a of volume 75d7da4a-9de0-49b1-911a-8682a8708656 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce42347-1c49-4ff2-b3ce-87f953062ff1]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:13 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 Jul 19 17:45:13 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Acquiring lock "cinder-db794569-988a-425c-8452-99065e863913-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Lock "cinder-db794569-988a-425c-8452-99065e863913-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Acquiring lock "cinder-quobyte-db794569-988a-425c-8452-99065e863913" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Lock "cinder-quobyte-db794569-988a-425c-8452-99065e863913" acquired by "delete_volume" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eb3b77-8c39-4101-ab56-0676e49b9354]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-db794569-988a-425c-8452-99065e863913 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:14 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:14 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03" returned: 0 in 0.650s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656" returned: 0 in 0.555s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:14 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03 Jul 19 17:45:14 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:14 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a 1G Jul 19 17:45:14 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:14 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-db794569-988a-425c-8452-99065e863913 Jul 19 17:45:14 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:14 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.a95e60a3-1ec4-43f1-8415-40e88d417c03" returned: 0 in 0.375s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-quobyte-a95e60a3-1ec4-43f1-8415-40e88d417c03" released by "_delete_snapshot" :: held 2.336s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-quobyte-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" released by "delete_snapshot" :: held 2.375s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:14 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-db794569-988a-425c-8452-99065e863913" returned: 0 in 0.507s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-db794569-988a-425c-8452-99065e863913 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:14 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-db794569-988a-425c-8452-99065e863913 Jul 19 17:45:14 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Created reservations ['76e8a8a4-3236-4654-a14a-71592d400540', '85aac6c0-bd20-4631-9c39-e10db776bf86', '386b423b-3544-486d-a43c-b25c41ba9e15', 'a2193bfd-1185-48a3-8cdd-8908ded3d213'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:45:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Delete snapshot completed successfully. Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-18c6b097-e914-4628-adba-0af3b5b24908 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-a95e60a3-1ec4-43f1-8415-40e88d417c03-delete_snapshot" released by "delete_snapshot" :: held 2.654s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:14 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a 1G" returned: 0 in 0.765s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d7da4a-9de0-49b1-911a-8682a8708656 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-6f93ba52-49a9-4f05-aa2f-95493db473cc req-38710767-d0a7-424d-9a42-762038959384 tempest-TestShelveInstance-126331557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:14 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d7da4a-9de0-49b1-911a-8682a8708656 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a Jul 19 17:45:14 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:14 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-db794569-988a-425c-8452-99065e863913" returned: 0 in 0.369s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Lock "cinder-quobyte-db794569-988a-425c-8452-99065e863913" released by "delete_volume" :: held 0.935s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Created reservations ['632efc94-ef49-4bdf-a80c-ece5d2e30d59', '3273260f-34fc-44ad-aeba-2610041b4e28', '5bb4d082-5508-4f72-8c62-cb5a87110849', 'a7865c03-e878-4086-b9bd-066577686674'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:15 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:45:15 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "cinder-0612e65b-f359-4737-8de8-3128b116ff61-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-0612e65b-f359-4737-8de8-3128b116ff61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "cinder-quobyte-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:15 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d7da4a-9de0-49b1-911a-8682a8708656 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a" returned: 0 in 0.607s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:15 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a is being set with open permissions: ugo+rw Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:15 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a Jul 19 17:45:15 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-quobyte-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "cinder-quobyte-0612e65b-f359-4737-8de8-3128b116ff61" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-quobyte-0612e65b-f359-4737-8de8-3128b116ff61" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Deleting offline snapshot 0612e65b-f359-4737-8de8-3128b116ff61 of volume 113403d8-00a1-4a5d-b71f-8fda36a4b5c4 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] snapshot_file for this snap is: volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[47441047-3a67-4422-8b99-9d9f6b0aefc2]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:15 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.518s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:45:15 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Deleted volume successfully. Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-86357f49-856c-4814-8a65-c11796c749f3 tempest-VolumesNegativeTest-73819055 None] Lock "cinder-db794569-988a-425c-8452-99065e863913-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:15 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 Jul 19 17:45:15 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:15 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a" returned: 0 in 0.355s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:15 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.info Jul 19 17:45:15 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:16 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61" returned: 0 in 0.503s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a6c750-f054-4734-b074-178abf39ddf0]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:16 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.info" returned: 0 in 0.296s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:16 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.info is being set with open permissions: ugo+rw Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:16 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.info Jul 19 17:45:16 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:16 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 Jul 19 17:45:16 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:16 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.info" returned: 0 in 0.359s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Acquiring lock "cinder-quobyte-f1d8c449-30a0-4623-bb94-73f9a80cd468" by "_copy_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-f1d8c449-30a0-4623-bb94-73f9a80cd468" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] snapshot: 0dca8b93-c2bf-4492-8cfc-256e7f2f420a, volume: f1d8c449-30a0-4623-bb94-73f9a80cd468, {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aa29ca-7f2a-4ef4-8462-ea8639680392]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:16 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760" returned: 0 in 0.593s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:45:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:16 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a Jul 19 17:45:16 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:16 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 Jul 19 17:45:16 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:17 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a" returned: 0 in 0.474s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75d7da4a-9de0-49b1-911a-8682a8708656(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:45:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] will copy from snapshot at /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 17:45:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Creating direct copy from snapshot {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 17:45:17 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[29308c67-e3a2-417e-a563-cba4bb235bdc]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:17 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 Jul 19 17:45:17 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:17 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61" returned: 0 in 0.526s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:17 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61 Jul 19 17:45:17 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:17 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656" returned: 0 in 0.453s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:17 devstack cinder-volume[87676]: DEBUG cinder.utils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Path /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f1d8c449-30a0-4623-bb94-73f9a80cd468 not found in is_blk_device check {{(pid=87676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 17:45:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f1d8c449-30a0-4623-bb94-73f9a80cd468 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:17 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.0612e65b-f359-4737-8de8-3128b116ff61" returned: 0 in 0.339s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:17 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f1d8c449-30a0-4623-bb94-73f9a80cd468 Jul 19 17:45:17 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:17 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-quobyte-0612e65b-f359-4737-8de8-3128b116ff61" released by "_delete_snapshot" :: held 2.110s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:17 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-quobyte-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" released by "delete_snapshot" :: held 2.155s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:17 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Created reservations ['1f68ccaf-a429-4702-88a9-9c4fc2a6b8c1', '71075939-2e28-4476-8a9a-20335038de6f', 'b3531044-a9cc-426b-ba0a-d88f9f512f40', '690c9756-3bc4-4607-b5e9-6820277f8ad9'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:45:17 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Delete snapshot completed successfully. Jul 19 17:45:17 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4386f960-82ab-4ca9-ac3d-8c2f966005d0 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-0612e65b-f359-4737-8de8-3128b116ff61-delete_snapshot" released by "delete_snapshot" :: held 2.407s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:18 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "cinder-4022d23f-d777-43d8-9dd3-ea4d3c490760-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-4022d23f-d777-43d8-9dd3-ea4d3c490760-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "cinder-quobyte-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-quobyte-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "cinder-quobyte-4022d23f-d777-43d8-9dd3-ea4d3c490760" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-quobyte-4022d23f-d777-43d8-9dd3-ea4d3c490760" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Deleting offline snapshot 4022d23f-d777-43d8-9dd3-ea4d3c490760 of volume 113403d8-00a1-4a5d-b71f-8fda36a4b5c4 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:45:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] snapshot_file for this snap is: volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:45:19 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aa16c5-573f-40e4-baad-176a40ef164d]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:19 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 Jul 19 17:45:19 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:20 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760" returned: 0 in 1.097s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:45:20 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05d56b3-8c9f-46f0-88bd-5b1a682c9cea]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:20 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 Jul 19 17:45:20 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:21 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" returned: 0 in 0.860s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:21 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 Jul 19 17:45:21 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:22 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760" returned: 0 in 0.805s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:22 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760 Jul 19 17:45:22 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:22 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4.4022d23f-d777-43d8-9dd3-ea4d3c490760" returned: 0 in 0.632s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-quobyte-4022d23f-d777-43d8-9dd3-ea4d3c490760" released by "_delete_snapshot" :: held 3.740s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-quobyte-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" released by "delete_snapshot" :: held 3.778s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:23 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Created reservations ['e92b50fd-664e-4e46-940a-7a01799cfb41', '76e7976e-c753-47ee-96a9-b6479baedfb8', '82766246-8a3e-4b1a-a294-f0f192e43936', '682b6429-4379-453a-9447-86a244e52762'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:45:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Delete snapshot completed successfully. Jul 19 17:45:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9cb117a3-9f00-4d8a-b0e4-55c4403c1ff2 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-4022d23f-d777-43d8-9dd3-ea4d3c490760-delete_snapshot" released by "delete_snapshot" :: held 4.263s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:23 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f1d8c449-30a0-4623-bb94-73f9a80cd468" returned: 0 in 5.762s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:23 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16b3cb3-9de7-4e1b-b75d-5d813fe50b65]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "cinder-113403d8-00a1-4a5d-b71f-8fda36a4b5c4-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:23 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 Jul 19 17:45:23 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-113403d8-00a1-4a5d-b71f-8fda36a4b5c4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "cinder-quobyte-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-quobyte-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" acquired by "delete_volume" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:23 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[81236db7-62ef-475b-b572-7175a2141ed8]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:23 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 Jul 19 17:45:23 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:24 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656" returned: 0 in 0.619s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Image conversion details: src /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f1d8c449-30a0-4623-bb94-73f9a80cd468 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:45:24 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Converted 1024.00 MB image at 177.67 MB/s Jul 19 17:45:24 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f1d8c449-30a0-4623-bb94-73f9a80cd468 is being set with open permissions: ugo+rw Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f1d8c449-30a0-4623-bb94-73f9a80cd468 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:24 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f1d8c449-30a0-4623-bb94-73f9a80cd468 Jul 19 17:45:24 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:24 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" returned: 0 in 0.434s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:24 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4 Jul 19 17:45:24 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:24 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f1d8c449-30a0-4623-bb94-73f9a80cd468" returned: 0 in 0.288s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-f1d8c449-30a0-4623-bb94-73f9a80cd468" released by "_copy_volume_from_snapshot" :: held 7.717s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Acquiring lock "cinder-quobyte-0dca8b93-c2bf-4492-8cfc-256e7f2f420a" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-0dca8b93-c2bf-4492-8cfc-256e7f2f420a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:24 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Deleting offline snapshot 0dca8b93-c2bf-4492-8cfc-256e7f2f420a of volume 75d7da4a-9de0-49b1-911a-8682a8708656 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] snapshot_file for this snap is: volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" returned: 0 in 0.315s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d45e002-2d7b-46f1-8e58-5f8d47caeaa0]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-quobyte-113403d8-00a1-4a5d-b71f-8fda36a4b5c4" released by "delete_volume" :: held 0.847s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Created reservations ['979ab457-ee38-4d68-a822-38cfeb099019', 'c4b7ae68-feca-4e68-9008-dc416b3dd5c8', 'a944df7a-3525-487e-90aa-3d06e3738da9', '287d342d-b037-4ad1-9f58-8fdcf97a69c9'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:24 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a Jul 19 17:45:24 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:24 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:45:24 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:24 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a" returned: 0 in 0.518s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75d7da4a-9de0-49b1-911a-8682a8708656(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:45:24 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.354s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:45:24 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Deleted volume successfully. Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1ff7e6-255d-4cbe-a918-e4b9eabd3017]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d951193e-e8ad-43c5-a4c1-c641920328a6 tempest-VolumesSnapshotListTestJSON-1943658479 None] Lock "cinder-113403d8-00a1-4a5d-b71f-8fda36a4b5c4-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:25 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 Jul 19 17:45:25 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:25 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656" returned: 0 in 0.383s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:25 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a Jul 19 17:45:25 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:25 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a" returned: 0 in 0.459s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:25 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a Jul 19 17:45:25 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:26 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656.0dca8b93-c2bf-4492-8cfc-256e7f2f420a" returned: 0 in 0.292s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-0dca8b93-c2bf-4492-8cfc-256e7f2f420a" released by "_delete_snapshot" :: held 1.790s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.718s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-6f93ba52-49a9-4f05-aa2f-95493db473cc req-38710767-d0a7-424d-9a42-762038959384 tempest-TestShelveInstance-126331557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.287s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-6f93ba52-49a9-4f05-aa2f-95493db473cc req-38710767-d0a7-424d-9a42-762038959384 tempest-TestShelveInstance-126331557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2635581c-1ecd-48c8-871c-e7ee991974ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d8c449-30a0-4623-bb94-73f9a80cd468', 'volume_size': 1, 'source_volid': '75d7da4a-9de0-49b1-911a-8682a8708656', 'source_volstatus': 'available'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63fea3e5-10f5-4f7e-ac52-ec0d4999acdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:26 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Volume volume-f1d8c449-30a0-4623-bb94-73f9a80cd468 (f1d8c449-30a0-4623-bb94-73f9a80cd468): created successfully Jul 19 17:45:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63fea3e5-10f5-4f7e-ac52-ec0d4999acdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Flow 'volume_create_manager' (3f872067-eee5-40eb-b456-c12d727a2423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-6f93ba52-49a9-4f05-aa2f-95493db473cc req-38710767-d0a7-424d-9a42-762038959384 tempest-TestShelveInstance-126331557 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-44f41603-daba-4e6c-84b2-0f46dfac4e89', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bbeb00d-9b6d-4aaf-8b41-b6f80625b8e6', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:45:26 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-29c7d43c-947d-4517-8f32-18f2f49f8bb5 tempest-VolumesGetTest-283534734 None] Created volume successfully. Jul 19 17:45:26 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-6f93ba52-49a9-4f05-aa2f-95493db473cc req-38710767-d0a7-424d-9a42-762038959384 tempest-TestShelveInstance-126331557 None] attachment_update completed successfully. Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Flow 'volume_create_manager' (5fc33025-d32b-44e7-9c24-80692145d27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec47b97f-74e8-4009-80cb-de6ddc104a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec47b97f-74e8-4009-80cb-de6ddc104a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-280660701',display_name='tempest-VolumesGetTest-Volume-777957223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042a3ae1-337d-467b-9bb5-cc5ed7ec4e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9243001ff97e4f5d83ee80da8e7bba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:28Z,use_quota=True,user_id='a368301f719b47a3b9387a1ffba10b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d56a4a9-d855-43a0-a130-babed7a21b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d56a4a9-d855-43a0-a130-babed7a21b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5695bd35-db2a-4bce-837a-5a40881020a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5695bd35-db2a-4bce-837a-5a40881020a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '042a3ae1-337d-467b-9bb5-cc5ed7ec4e53', 'volume_name': 'volume-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccfb6531-512a-4b0d-a965-ba3f3fd8c957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccfb6531-512a-4b0d-a965-ba3f3fd8c957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491214ad-c39a-4068-892c-c1f5e3b50172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:28 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Volume 042a3ae1-337d-467b-9bb5-cc5ed7ec4e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53', 'volume_size': 1} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-280660701',display_name='tempest-VolumesGetTest-Volume-777957223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042a3ae1-337d-467b-9bb5-cc5ed7ec4e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9243001ff97e4f5d83ee80da8e7bba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:28Z,use_quota=True,user_id='a368301f719b47a3b9387a1ffba10b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Creating volume 042a3ae1-337d-467b-9bb5-cc5ed7ec4e53 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:45:28 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:45:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:28 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53 1073741824 Jul 19 17:45:28 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:29 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53 1073741824" returned: 0 in 0.803s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:29 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53 Jul 19 17:45:29 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:29 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53" returned: 0 in 0.387s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:29 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:45:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491214ad-c39a-4068-892c-c1f5e3b50172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db56b6ce-0670-4680-bc9d-dc64179c3c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:29 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Volume volume-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53 (042a3ae1-337d-467b-9bb5-cc5ed7ec4e53): created successfully Jul 19 17:45:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db56b6ce-0670-4680-bc9d-dc64179c3c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Flow 'volume_create_manager' (5fc33025-d32b-44e7-9c24-80692145d27d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:29 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-54e5bf94-570b-40a7-ae53-acfb12b4d9b5 tempest-VolumesGetTest-283534734 None] Created volume successfully. Jul 19 17:45:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Acquiring lock "cinder-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Lock "cinder-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Acquiring lock "cinder-quobyte-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53" acquired by "delete_volume" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:30 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5907d577-e12b-468e-b871-b1c30e233c12]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:30 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53 Jul 19 17:45:30 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:31 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53" returned: 0 in 0.594s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:31 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53 Jul 19 17:45:31 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:31 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53" returned: 0 in 0.402s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:31 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53" released by "delete_volume" :: held 1.094s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:31 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Created reservations ['9a844027-9b07-4d28-9587-6981ea2e4aa3', '06199c8c-3c02-48e0-879f-0d605b173263', '44d8d2ea-8dce-4ee7-b1ed-5fd350be73b2', 'd38c252e-6a87-4397-bf9d-08380a22006b'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:45:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:31 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:45:31 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:32 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.413s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:32 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:45:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Deleted volume successfully. Jul 19 17:45:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff0c293f-90f8-4327-90c9-c84dbfc3214a tempest-VolumesGetTest-283534734 None] Lock "cinder-042a3ae1-337d-467b-9bb5-cc5ed7ec4e53-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Acquiring lock "cinder-f1d8c449-30a0-4623-bb94-73f9a80cd468-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Lock "cinder-f1d8c449-30a0-4623-bb94-73f9a80cd468-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Acquiring lock "cinder-quobyte-f1d8c449-30a0-4623-bb94-73f9a80cd468" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-f1d8c449-30a0-4623-bb94-73f9a80cd468" acquired by "delete_volume" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:33 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[974e3672-35d5-46e4-a16c-7f9f5c9c3fbf]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f1d8c449-30a0-4623-bb94-73f9a80cd468 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:33 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f1d8c449-30a0-4623-bb94-73f9a80cd468 Jul 19 17:45:33 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:33 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f1d8c449-30a0-4623-bb94-73f9a80cd468" returned: 0 in 0.539s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f1d8c449-30a0-4623-bb94-73f9a80cd468 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:33 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f1d8c449-30a0-4623-bb94-73f9a80cd468 Jul 19 17:45:33 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:34 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-f1d8c449-30a0-4623-bb94-73f9a80cd468" returned: 0 in 0.447s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-f1d8c449-30a0-4623-bb94-73f9a80cd468" released by "delete_volume" :: held 1.073s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Created reservations ['cc29adae-7935-4ccb-b8ca-27ed68c79a87', '1fd65eb4-5d81-46bd-890a-499c083fe293', '7e6a9539-0548-4dcf-afc3-bdc0dc6afeca', 'bb2b0fb0-7194-49e3-b19a-8e7752fbe7c3'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:34 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:45:34 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:34 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.426s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:45:34 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Deleted volume successfully. Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9747d08e-3ad3-4d05-8c60-c0c75a674eed tempest-VolumesGetTest-283534734 None] Lock "cinder-f1d8c449-30a0-4623-bb94-73f9a80cd468-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:35 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:45:35 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Acquiring lock "cinder-75d7da4a-9de0-49b1-911a-8682a8708656-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Lock "cinder-75d7da4a-9de0-49b1-911a-8682a8708656-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:35 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.553s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:45:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:45:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 28 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:45:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:45:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Acquiring lock "cinder-quobyte-75d7da4a-9de0-49b1-911a-8682a8708656" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-75d7da4a-9de0-49b1-911a-8682a8708656" acquired by "delete_volume" :: waited 0.033s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:35 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dc3500-b89a-4581-98e9-95a74e3fc67e]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:35 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 Jul 19 17:45:35 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:36 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656" returned: 0 in 0.639s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:36 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656 Jul 19 17:45:36 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:36 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75d7da4a-9de0-49b1-911a-8682a8708656" returned: 0 in 0.379s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-75d7da4a-9de0-49b1-911a-8682a8708656" released by "delete_volume" :: held 1.159s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:36 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Created reservations ['65c477a3-7b41-4fd4-9f05-3bddc7d310a7', '69ae87a4-b886-4930-93b8-9b5d2dd9aac1', '8e3d260b-828f-4f57-8a98-85b896528923', '2fa28ba7-22f2-4eba-bf60-ea7778e3ee4b'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:37 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:45:37 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Flow 'volume_create_manager' (fcca7271-86e1-4f8a-bfbf-016f3a5fa3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afe3a07-ae2d-4379-9d61-a2fff58ef6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afe3a07-ae2d-4379-9d61-a2fff58ef6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2009170504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efa6684-5c37-4ffe-8311-4c9a009f0455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78cbcb9735c41758f82184ff495975b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:37Z,use_quota=True,user_id='6fe9bacd59a54dbdba38561b39c90187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff463ce-fba7-4403-b58b-ebd6235be7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff463ce-fba7-4403-b58b-ebd6235be7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5900ad-6d66-469d-9877-a2e735c3573d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5900ad-6d66-469d-9877-a2e735c3573d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4efa6684-5c37-4ffe-8311-4c9a009f0455', 'volume_name': 'volume-4efa6684-5c37-4ffe-8311-4c9a009f0455', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebd1215-4dcc-4a2f-9d55-748cc4e66ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebd1215-4dcc-4a2f-9d55-748cc4e66ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8a6a78-b591-402e-a3b7-a72a8cce7f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:37 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Volume 4efa6684-5c37-4ffe-8311-4c9a009f0455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4efa6684-5c37-4ffe-8311-4c9a009f0455', 'volume_size': 1} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2009170504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efa6684-5c37-4ffe-8311-4c9a009f0455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78cbcb9735c41758f82184ff495975b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:37Z,use_quota=True,user_id='6fe9bacd59a54dbdba38561b39c90187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Creating volume 4efa6684-5c37-4ffe-8311-4c9a009f0455 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:45:37 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:37 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 1073741824 Jul 19 17:45:37 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:37 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.408s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:45:37 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Deleted volume successfully. Jul 19 17:45:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f9a49194-6acd-4535-a848-770a40e9f7dc tempest-VolumesGetTest-283534734 None] Lock "cinder-75d7da4a-9de0-49b1-911a-8682a8708656-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:38 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 1073741824" returned: 0 in 0.881s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:38 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 Jul 19 17:45:38 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:38 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455" returned: 0 in 0.527s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:45:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8a6a78-b591-402e-a3b7-a72a8cce7f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4efa6684-5c37-4ffe-8311-4c9a009f0455', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7dd25cf-60a8-4616-8662-bc9f71d569b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:39 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Volume volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 (4efa6684-5c37-4ffe-8311-4c9a009f0455): created successfully Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7dd25cf-60a8-4616-8662-bc9f71d569b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Flow 'volume_create_manager' (fcca7271-86e1-4f8a-bfbf-016f3a5fa3dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:39 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-92425359-64f3-4df2-b458-ed34f5e487ac tempest-VolumesSnapshotTestJSON-1396088549 None] Created volume successfully. Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Flow 'volume_create_manager' (36a1a28a-7a94-4ae4-a205-5d05477eabb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc73b9e-61a2-46f6-85b7-55f84bac6d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc73b9e-61a2-46f6-85b7-55f84bac6d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-816323528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9243001ff97e4f5d83ee80da8e7bba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:39Z,use_quota=True,user_id='a368301f719b47a3b9387a1ffba10b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e89370-96f8-4d4a-ae69-0eea7c13211a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e89370-96f8-4d4a-ae69-0eea7c13211a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0c14aa-9850-422e-b685-cb8895d5d964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.image.glance [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Creating Keystone auth plugin from conf {{(pid=87676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0c14aa-9850-422e-b685-cb8895d5d964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3ae94e1-7099-4c4a-9d3e-17c8dd671dd2', 'volume_name': 'volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2', 'volume_size': 1, 'image_id': '3f690ae5-6466-476d-bb48-a634301656d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b6bd91692f74fd082fc706a6071a464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3f690ae5-6466-476d-bb48-a634301656d0', 'created_at': datetime.datetime(2026, 7, 19, 15, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 29, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f690ae5-6466-476d-bb48-a634301656d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9644e5b-0098-46f1-881c-de4cab97756d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9644e5b-0098-46f1-881c-de4cab97756d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f3bce6-f5a0-4302-99eb-ca7a4a44ef20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:39 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Volume d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2', 'volume_size': 1, 'image_id': '3f690ae5-6466-476d-bb48-a634301656d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b6bd91692f74fd082fc706a6071a464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3f690ae5-6466-476d-bb48-a634301656d0', 'created_at': datetime.datetime(2026, 7, 19, 15, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 29, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f690ae5-6466-476d-bb48-a634301656d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 19 17:45:39 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Trying to clone d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 from image 3f690ae5-6466-476d-bb48-a634301656d0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}]). {{(pid=87676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 17:45:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:40 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] Creating offline snapshot 739ac3b4-f3a3-4dc9-ac84-a5939405bc08 of volume 4efa6684-5c37-4ffe-8311-4c9a009f0455 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:45:40 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18e4fe0-7328-44fc-be1f-0f0a7e1e940f]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:40 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 Jul 19 17:45:40 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:40 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_eqz_3mgkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 17:45:40 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Image download 20.69 MB at 20.69 MB/s Jul 19 17:45:40 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97d1a52-174d-444d-afe6-f19f49834e59]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_eqz_3mgkdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:40 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455" returned: 0 in 0.812s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:40 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08 1G Jul 19 17:45:40 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:41 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_eqz_3mgkdevstack@QuobyteHD Jul 19 17:45:41 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:41 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_eqz_3mgkdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:41 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Temporary image 3f690ae5-6466-476d-bb48-a634301656d0 is fetched for user a368301f719b47a3b9387a1ffba10b9d. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 17:45:41 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b168d5e1-b87f-4261-a38f-b2511b3e500f]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_eqz_3mgkdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:41 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_eqz_3mgkdevstack@QuobyteHD Jul 19 17:45:41 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:41 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08 1G" returned: 0 in 0.794s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:41 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08 Jul 19 17:45:41 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:42 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_eqz_3mgkdevstack@QuobyteHD" returned: 0 in 0.663s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:42 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08" returned: 0 in 0.491s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:42 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08 is being set with open permissions: ugo+rw Jul 19 17:45:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:42 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08 Jul 19 17:45:42 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:42 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08" returned: 0 in 0.403s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:42 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.info Jul 19 17:45:42 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:42 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.info" returned: 0 in 0.303s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:42 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.info is being set with open permissions: ugo+rw Jul 19 17:45:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:43 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.info Jul 19 17:45:43 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:43 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.info" returned: 0 in 0.303s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.263s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.159s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-816323528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9243001ff97e4f5d83ee80da8e7bba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:39Z,use_quota=True,user_id='a368301f719b47a3b9387a1ffba10b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:45:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Creating volume d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:45:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:45:43 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:45:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:43 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 1073741824 Jul 19 17:45:43 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:43 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f54a18e0-b5c4-477f-93f1-136527c8879d tempest-VolumesSnapshotTestJSON-1396088549 None] Create snapshot completed successfully Jul 19 17:45:43 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 1073741824" returned: 0 in 0.545s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:43 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 Jul 19 17:45:43 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:44 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2" returned: 0 in 0.310s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Attempting download of 3f690ae5-6466-476d-bb48-a634301656d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}])) to volume d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbce4a66-7cda-486b-b2fe-031b116dfde7]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_hu3lef4g {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-739ac3b4-f3a3-4dc9-ac84-a5939405bc08-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-739ac3b4-f3a3-4dc9-ac84-a5939405bc08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-quobyte-4efa6684-5c37-4ffe-8311-4c9a009f0455" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-4efa6684-5c37-4ffe-8311-4c9a009f0455" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-quobyte-739ac3b4-f3a3-4dc9-ac84-a5939405bc08" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:44 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_hu3lef4g Jul 19 17:45:44 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-739ac3b4-f3a3-4dc9-ac84-a5939405bc08" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Deleting offline snapshot 739ac3b4-f3a3-4dc9-ac84-a5939405bc08 of volume 4efa6684-5c37-4ffe-8311-4c9a009f0455 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] snapshot_file for this snap is: volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdb7200-471e-492f-8afb-3bdf05eb5835]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:44 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08 Jul 19 17:45:44 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:44 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_hu3lef4g" returned: 0 in 0.449s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_hu3lef4g {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:44 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_hu3lef4g Jul 19 17:45:44 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:45 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08" returned: 0 in 0.490s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efa6684-5c37-4ffe-8311-4c9a009f0455(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:45:45 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b92d02c-390b-460d-9f6c-f2a880d1f4d7]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:45 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_hu3lef4g" returned: 1 in 0.383s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f690ae5-6466-476d-bb48-a634301656d0_hu3lef4g' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:45:45 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cbb162-12b0-4fc1-88fa-71e70416e070]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_eqz_3mgkdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:45 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 Jul 19 17:45:45 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:45 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_eqz_3mgkdevstack@QuobyteHD Jul 19 17:45:45 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:45 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455" returned: 0 in 0.453s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:45 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08 Jul 19 17:45:45 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:45 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_eqz_3mgkdevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:45 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] 3f690ae5-6466-476d-bb48-a634301656d0 was qcow2, converting to qcow2 {{(pid=87676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 17:45:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_eqz_3mgkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:45 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_eqz_3mgkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 Jul 19 17:45:45 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:46 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08" returned: 0 in 0.529s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:46 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08 Jul 19 17:45:46 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:46 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455.739ac3b4-f3a3-4dc9-ac84-a5939405bc08" returned: 0 in 0.327s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-739ac3b4-f3a3-4dc9-ac84-a5939405bc08" released by "_delete_snapshot" :: held 1.970s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-4efa6684-5c37-4ffe-8311-4c9a009f0455" released by "delete_snapshot" :: held 2.008s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:46 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Created reservations ['b548e931-84a4-4af5-8964-ab7bb82ed98d', '0c36f704-74ab-44c8-a079-07763c2f5eab', 'b0988564-9b68-4958-9c62-e8197782883b', '29f1ae09-fccc-4eed-ac3c-af26b83ffdb5'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:45:46 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Delete snapshot completed successfully. Jul 19 17:45:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-56a4eb81-ec0e-4762-979e-83b1f0b6ca35 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-739ac3b4-f3a3-4dc9-ac84-a5939405bc08-delete_snapshot" released by "delete_snapshot" :: held 2.251s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:48 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_eqz_3mgkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2" returned: 0 in 2.362s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3f690ae5-6466-476d-bb48-a634301656d0_eqz_3mgkdevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:45:48 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Converted 112.00 MB image at 47.40 MB/s Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:48 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 1G Jul 19 17:45:48 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Flow 'volume_create_manager' (3c8969d2-0a9b-42c8-b4fd-468ed8f8f367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e79f57c-e627-43bd-8a63-ebeb5a0c3263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e79f57c-e627-43bd-8a63-ebeb5a0c3263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1361553708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc37694f-ad41-4502-a7b1-ed4eb9b45bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78cbcb9735c41758f82184ff495975b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:48Z,use_quota=True,user_id='6fe9bacd59a54dbdba38561b39c90187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea92a3c-e3c8-42a7-b96b-7a14e86a530b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea92a3c-e3c8-42a7-b96b-7a14e86a530b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f68854-cece-4fe9-95a6-6e254b4d3b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f68854-cece-4fe9-95a6-6e254b4d3b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc37694f-ad41-4502-a7b1-ed4eb9b45bb8', 'volume_name': 'volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0ce864-6593-487e-b339-4ce7722a32ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:48 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0ce864-6593-487e-b339-4ce7722a32ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87f9265-3ffa-412a-92e3-4acde8eff7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:48 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Volume bc37694f-ad41-4502-a7b1-ed4eb9b45bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8', 'volume_size': 1} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1361553708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc37694f-ad41-4502-a7b1-ed4eb9b45bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78cbcb9735c41758f82184ff495975b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:48Z,use_quota=True,user_id='6fe9bacd59a54dbdba38561b39c90187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Creating volume bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:45:48 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 1G" returned: 0 in 0.451s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Downloaded image 3f690ae5-6466-476d-bb48-a634301656d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}])) to volume d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 successfully. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Temporary image 3f690ae5-6466-476d-bb48-a634301656d0 for user a368301f719b47a3b9387a1ffba10b9d is deleted. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Marking volume d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 as bootable. {{(pid=87676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 17:45:48 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 1073741824 Jul 19 17:45:48 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Copying metadata from image 3f690ae5-6466-476d-bb48-a634301656d0 to d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2. {{(pid=87676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Creating volume glance metadata for volume d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 backed by image 3f690ae5-6466-476d-bb48-a634301656d0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3f690ae5-6466-476d-bb48-a634301656d0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f3bce6-f5a0-4302-99eb-ca7a4a44ef20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2', 'volume_size': 1, 'image_id': '3f690ae5-6466-476d-bb48-a634301656d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f690ae5-6466-476d-bb48-a634301656d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7b6bd91692f74fd082fc706a6071a464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3f690ae5-6466-476d-bb48-a634301656d0', 'created_at': datetime.datetime(2026, 7, 19, 15, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 29, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f690ae5-6466-476d-bb48-a634301656d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e69981-8d72-4f6d-a2c1-44f206eabd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:48 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Volume volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 (d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2): created successfully Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e69981-8d72-4f6d-a2c1-44f206eabd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Flow 'volume_create_manager' (36a1a28a-7a94-4ae4-a205-5d05477eabb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:48 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a4e0fb07-779e-4ba4-a601-8e067528bf3c tempest-VolumesGetTest-283534734 None] Created volume successfully. Jul 19 17:45:49 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 1073741824" returned: 0 in 0.479s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:49 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 Jul 19 17:45:49 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:49 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8" returned: 0 in 0.307s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87f9265-3ffa-412a-92e3-4acde8eff7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9a382f-9f28-43b0-99ad-ba3157c0f143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:49 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Volume volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 (bc37694f-ad41-4502-a7b1-ed4eb9b45bb8): created successfully Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9a382f-9f28-43b0-99ad-ba3157c0f143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Flow 'volume_create_manager' (3c8969d2-0a9b-42c8-b4fd-468ed8f8f367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:49 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-abcdfb30-1a29-42dc-bc48-66212ce7cef4 tempest-VolumesSnapshotTestJSON-1396088549 None] Created volume successfully. Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Flow 'volume_create_manager' (b01a7109-7bf3-4982-821d-ea1905cbb27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e750cd1-4ee8-462a-9491-052f657a78c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e750cd1-4ee8-462a-9491-052f657a78c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-664566566',display_name='tempest-VolumesGetTest-Volume-35247138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354acbb8-67ef-4b13-be64-48b897099d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9243001ff97e4f5d83ee80da8e7bba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:50Z,use_quota=True,user_id='a368301f719b47a3b9387a1ffba10b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4840d72f-b324-4f7d-b459-6890c3b55d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4840d72f-b324-4f7d-b459-6890c3b55d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3456f324-4629-4d74-85de-65667a29b9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3456f324-4629-4d74-85de-65667a29b9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '354acbb8-67ef-4b13-be64-48b897099d35', 'volume_name': 'volume-354acbb8-67ef-4b13-be64-48b897099d35', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ade21d-47bc-4295-b159-841fd76b65c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ade21d-47bc-4295-b159-841fd76b65c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f73b00-4c99-497f-8b2a-27b558325c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:49 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Volume 354acbb8-67ef-4b13-be64-48b897099d35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-354acbb8-67ef-4b13-be64-48b897099d35', 'volume_size': 1} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-664566566',display_name='tempest-VolumesGetTest-Volume-35247138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354acbb8-67ef-4b13-be64-48b897099d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9243001ff97e4f5d83ee80da8e7bba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:50Z,use_quota=True,user_id='a368301f719b47a3b9387a1ffba10b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Creating volume 354acbb8-67ef-4b13-be64-48b897099d35 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:45:49 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:45:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-354acbb8-67ef-4b13-be64-48b897099d35 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:49 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-354acbb8-67ef-4b13-be64-48b897099d35 1073741824 Jul 19 17:45:49 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:50 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-354acbb8-67ef-4b13-be64-48b897099d35 1073741824" returned: 0 in 0.412s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-354acbb8-67ef-4b13-be64-48b897099d35 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:50 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-354acbb8-67ef-4b13-be64-48b897099d35 Jul 19 17:45:50 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:50 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-354acbb8-67ef-4b13-be64-48b897099d35" returned: 0 in 0.317s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:45:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f73b00-4c99-497f-8b2a-27b558325c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-354acbb8-67ef-4b13-be64-48b897099d35', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d83b49-72dd-4fa7-bdc1-8d85c7f049b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] Creating offline snapshot c0d0f31c-c4a3-4955-a39b-3d79e355fe5f of volume bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:45:50 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Volume volume-354acbb8-67ef-4b13-be64-48b897099d35 (354acbb8-67ef-4b13-be64-48b897099d35): created successfully Jul 19 17:45:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d83b49-72dd-4fa7-bdc1-8d85c7f049b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Flow 'volume_create_manager' (b01a7109-7bf3-4982-821d-ea1905cbb27a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:50 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4c55b9-5ec3-4c6b-b75c-2cddfd08d407]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:50 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-bb4414e4-73b0-4564-91ee-a72ffde6a3c9 tempest-VolumesGetTest-283534734 None] Created volume successfully. Jul 19 17:45:50 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 Jul 19 17:45:50 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:51 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8" returned: 0 in 0.407s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:51 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f 1G Jul 19 17:45:51 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:51 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f 1G" returned: 0 in 0.412s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:51 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f Jul 19 17:45:51 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:51 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f" returned: 0 in 0.368s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:51 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f is being set with open permissions: ugo+rw Jul 19 17:45:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:52 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f Jul 19 17:45:52 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Acquiring lock "cinder-354acbb8-67ef-4b13-be64-48b897099d35-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Lock "cinder-354acbb8-67ef-4b13-be64-48b897099d35-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Acquiring lock "cinder-quobyte-354acbb8-67ef-4b13-be64-48b897099d35" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-354acbb8-67ef-4b13-be64-48b897099d35" acquired by "delete_volume" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:52 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7707021-4dd2-4a34-9c26-704986e6be9a]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-354acbb8-67ef-4b13-be64-48b897099d35 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:52 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f" returned: 0 in 0.388s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:52 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-354acbb8-67ef-4b13-be64-48b897099d35 Jul 19 17:45:52 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:52 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.info Jul 19 17:45:52 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:52 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-354acbb8-67ef-4b13-be64-48b897099d35" returned: 0 in 0.406s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-354acbb8-67ef-4b13-be64-48b897099d35 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:52 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.info" returned: 0 in 0.287s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:52 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.info is being set with open permissions: ugo+rw Jul 19 17:45:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:52 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-354acbb8-67ef-4b13-be64-48b897099d35 Jul 19 17:45:52 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:52 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.info Jul 19 17:45:52 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:53 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:53 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.info" returned: 0 in 0.369s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.389s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-354acbb8-67ef-4b13-be64-48b897099d35" returned: 0 in 0.436s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-354acbb8-67ef-4b13-be64-48b897099d35" released by "delete_volume" :: held 0.916s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:53 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-91c8857a-be37-48f3-bf11-d161e69384a3 tempest-VolumesSnapshotTestJSON-1396088549 None] Create snapshot completed successfully Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Created reservations ['3dc3a768-5b56-4a9a-9213-14be7753f812', '8b40217c-0388-4e01-a31d-0a1af3e5a225', '41fb01a4-2013-49a4-84e4-9b15f6cd71dc', 'e6dc3cca-5828-41f8-bd17-cdb616ea4468'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:53 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:45:53 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Acquiring lock "cinder-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Lock "cinder-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Acquiring lock "cinder-quobyte-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:53 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5f7ca2-cbc0-41cc-b02f-d7a7046fa767]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.474s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:45:53 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Deleted volume successfully. Jul 19 17:45:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce8f1bb9-140c-4e3b-86a8-2fe1c1298651 tempest-VolumesGetTest-283534734 None] Lock "cinder-354acbb8-67ef-4b13-be64-48b897099d35-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:53 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 Jul 19 17:45:53 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:54 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2" returned: 0 in 0.612s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:54 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2 Jul 19 17:45:54 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Flow 'volume_create_manager' (544c855f-3cb8-4f7b-b184-e09b5cfd7e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13743f8-2dd3-43ba-89c0-a9337f663497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13743f8-2dd3-43ba-89c0-a9337f663497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1578918937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5dc4537-8526-42ed-88d9-2a982f185fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78cbcb9735c41758f82184ff495975b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:45:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c0d0f31c-c4a3-4955-a39b-3d79e355fe5f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:45:55Z,use_quota=True,user_id='6fe9bacd59a54dbdba38561b39c90187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae858f9b-66b7-4f05-b65f-1b17cca697ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae858f9b-66b7-4f05-b65f-1b17cca697ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a45e19-d429-4507-a40c-28936409836b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a45e19-d429-4507-a40c-28936409836b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5dc4537-8526-42ed-88d9-2a982f185fa7', 'volume_name': 'volume-b5dc4537-8526-42ed-88d9-2a982f185fa7', 'volume_size': 2, 'snapshot_id': 'c0d0f31c-c4a3-4955-a39b-3d79e355fe5f'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5670dd50-1a12-4f1d-9921-e12238cdbc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5670dd50-1a12-4f1d-9921-e12238cdbc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc947681-8522-48ee-86d1-e90964f7996e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:45:54 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Volume b5dc4537-8526-42ed-88d9-2a982f185fa7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5dc4537-8526-42ed-88d9-2a982f185fa7', 'volume_size': 2, 'snapshot_id': 'c0d0f31c-c4a3-4955-a39b-3d79e355fe5f'} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-quobyte-c0d0f31c-c4a3-4955-a39b-3d79e355fe5f-b5dc4537-8526-42ed-88d9-2a982f185fa7" by "_create_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:54 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2" returned: 0 in 0.600s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-c0d0f31c-c4a3-4955-a39b-3d79e355fe5f-b5dc4537-8526-42ed-88d9-2a982f185fa7" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Creating volume b5dc4537-8526-42ed-88d9-2a982f185fa7 from snapshot c0d0f31c-c4a3-4955-a39b-3d79e355fe5f {{(pid=87676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-quobyte-b5dc4537-8526-42ed-88d9-2a982f185fa7" by "_copy_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:45:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Lock "cinder-quobyte-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2" released by "delete_volume" :: held 1.290s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-b5dc4537-8526-42ed-88d9-2a982f185fa7" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] snapshot: c0d0f31c-c4a3-4955-a39b-3d79e355fe5f, volume: b5dc4537-8526-42ed-88d9-2a982f185fa7, {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[860e7bbc-5b1e-44d6-ab2f-fe69a1d65894]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Created reservations ['edeb588c-b590-4cbf-a3ca-79f338091ad0', 'f38bc288-c2ca-47c7-a8b2-be552898b16f', 'db7f02b5-35ee-404c-bfb1-e452cecbb03c', 'c0fb3576-1e91-41bd-911c-49cdf42a7794'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:55 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f Jul 19 17:45:55 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:55 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:45:55 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:55 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.385s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:45:55 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Deleted volume successfully. Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-be0d2a4b-92d2-4364-9134-b092aa6b3267 tempest-VolumesGetTest-283534734 None] Lock "cinder-d3ae94e1-7099-4c4a-9d3e-17c8dd671dd2-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:45:55 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f" returned: 0 in 0.798s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] will copy from snapshot at /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Creating direct copy from snapshot {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0c98bb-9433-47a8-9c7c-eff49e0c7d96]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:45:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:56 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 Jul 19 17:45:56 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:45:56 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Jul 19 17:45:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8" returned: 0 in 0.436s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:45:56 devstack cinder-volume[87676]: DEBUG cinder.utils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Path /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5dc4537-8526-42ed-88d9-2a982f185fa7 not found in is_blk_device check {{(pid=87676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 17:45:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5dc4537-8526-42ed-88d9-2a982f185fa7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:45:56 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5dc4537-8526-42ed-88d9-2a982f185fa7 Jul 19 17:45:56 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:02 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5dc4537-8526-42ed-88d9-2a982f185fa7" returned: 0 in 6.352s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:02 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a531bdd-543b-4081-9e4f-0feffebb520b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:02 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 Jul 19 17:46:02 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:03 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8" returned: 0 in 0.675s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:03 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Image conversion details: src /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5dc4537-8526-42ed-88d9-2a982f185fa7 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:46:03 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Converted 1024.00 MB image at 161.18 MB/s Jul 19 17:46:03 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5dc4537-8526-42ed-88d9-2a982f185fa7 is being set with open permissions: ugo+rw Jul 19 17:46:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5dc4537-8526-42ed-88d9-2a982f185fa7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:03 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5dc4537-8526-42ed-88d9-2a982f185fa7 Jul 19 17:46:03 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:03 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5dc4537-8526-42ed-88d9-2a982f185fa7" returned: 0 in 0.555s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-b5dc4537-8526-42ed-88d9-2a982f185fa7" released by "_copy_volume_from_snapshot" :: held 8.951s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-c0d0f31c-c4a3-4955-a39b-3d79e355fe5f-b5dc4537-8526-42ed-88d9-2a982f185fa7" released by "_create_volume_from_snapshot" :: held 9.001s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.027s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:03 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=144,cinder:UPDATE=135,cinder:INSERT=43,cinder:DELETE=9 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:46:04 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=126,cinder:UPDATE=146,cinder:INSERT=51,cinder:DELETE=16 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:46:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc947681-8522-48ee-86d1-e90964f7996e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5dc4537-8526-42ed-88d9-2a982f185fa7', 'volume_size': 2, 'snapshot_id': 'c0d0f31c-c4a3-4955-a39b-3d79e355fe5f'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cb9f1b-0159-4e14-b334-54af1ac5765b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:04 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Volume volume-b5dc4537-8526-42ed-88d9-2a982f185fa7 (b5dc4537-8526-42ed-88d9-2a982f185fa7): created successfully Jul 19 17:46:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cb9f1b-0159-4e14-b334-54af1ac5765b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Flow 'volume_create_manager' (544c855f-3cb8-4f7b-b184-e09b5cfd7e0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:46:04 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8491fb93-a871-44fe-8a5b-9729b1476928 tempest-VolumesSnapshotTestJSON-1396088549 None] Created volume successfully. Jul 19 17:46:04 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-36931cc2-9e2f-4245-86c5-502db8cbb642 req-9ad169ef-6178-434d-ad94-860b622fef2c tempest-TestShelveInstance-126331557 None] Terminate volume connection completed successfully. Jul 19 17:46:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-36931cc2-9e2f-4245-86c5-502db8cbb642 req-9ad169ef-6178-434d-ad94-860b622fef2c tempest-TestShelveInstance-126331557 None] Deleting attachment 6bbeb00d-9b6d-4aaf-8b41-b6f80625b8e6. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-b5dc4537-8526-42ed-88d9-2a982f185fa7-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-b5dc4537-8526-42ed-88d9-2a982f185fa7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-quobyte-b5dc4537-8526-42ed-88d9-2a982f185fa7" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-b5dc4537-8526-42ed-88d9-2a982f185fa7" acquired by "delete_volume" :: waited 0.033s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ea921a-58b1-4cd4-b2b1-15bc17c6a7d8]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5dc4537-8526-42ed-88d9-2a982f185fa7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:46:05 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5dc4537-8526-42ed-88d9-2a982f185fa7 Jul 19 17:46:05 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Flow 'volume_create_manager' (03a705ad-b7e4-4a4c-81d1-1058fa350256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fea207-d95c-426b-9e91-61293603ddba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fea207-d95c-426b-9e91-61293603ddba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-685125099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7c0a74-6448-4222-b440-f80f567e1e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fb87244a814756a3e00327a4372daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:46:05Z,use_quota=True,user_id='9e5331c5a1bc4f459148cb5657f86a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(183535fa-186d-4c2d-b28a-97518982ceb3),volume_type_id=183535fa-186d-4c2d-b28a-97518982ceb3)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d193328-1235-4139-acff-4f532d331a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d193328-1235-4139-acff-4f532d331a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9707e52-31e4-47d2-9514-b99011c9f134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9707e52-31e4-47d2-9514-b99011c9f134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c7c0a74-6448-4222-b440-f80f567e1e6b', 'volume_name': 'volume-5c7c0a74-6448-4222-b440-f80f567e1e6b', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24140b0a-ee90-4439-bb7b-636b24ca3d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24140b0a-ee90-4439-bb7b-636b24ca3d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa7a7a2-a29f-4cb5-9c72-f27cce0dd23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:05 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Volume 5c7c0a74-6448-4222-b440-f80f567e1e6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c7c0a74-6448-4222-b440-f80f567e1e6b', 'volume_size': 1} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-685125099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7c0a74-6448-4222-b440-f80f567e1e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fb87244a814756a3e00327a4372daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:46:05Z,use_quota=True,user_id='9e5331c5a1bc4f459148cb5657f86a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(183535fa-186d-4c2d-b28a-97518982ceb3),volume_type_id=183535fa-186d-4c2d-b28a-97518982ceb3)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Creating volume 5c7c0a74-6448-4222-b440-f80f567e1e6b {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:46:05 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:46:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c7c0a74-6448-4222-b440-f80f567e1e6b 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:05 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c7c0a74-6448-4222-b440-f80f567e1e6b 1073741824 Jul 19 17:46:05 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:06 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5dc4537-8526-42ed-88d9-2a982f185fa7" returned: 0 in 0.720s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5dc4537-8526-42ed-88d9-2a982f185fa7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:06 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5dc4537-8526-42ed-88d9-2a982f185fa7 Jul 19 17:46:06 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Flow 'volume_create_manager' (f510c1f5-886a-41d5-a416-822e13f6a782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124054dd-623d-46d9-82b2-138fccad33d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124054dd-623d-46d9-82b2-138fccad33d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1120179641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f43ab3c-e835-4b22-b656-33f08811ecf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fb87244a814756a3e00327a4372daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:46:06Z,use_quota=True,user_id='9e5331c5a1bc4f459148cb5657f86a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d219e3c4-95a0-4250-94c9-803a65440baa),volume_type_id=d219e3c4-95a0-4250-94c9-803a65440baa)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21d187a-2904-439f-a202-d0edcd2f0a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21d187a-2904-439f-a202-d0edcd2f0a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf15fd1-2070-498c-a963-206b469dae32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf15fd1-2070-498c-a963-206b469dae32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f43ab3c-e835-4b22-b656-33f08811ecf9', 'volume_name': 'volume-9f43ab3c-e835-4b22-b656-33f08811ecf9', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee274c3-ec65-406f-956e-a0a3e843192c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee274c3-ec65-406f-956e-a0a3e843192c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1917fa6f-22fe-463b-b198-dab085979a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:06 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Volume 9f43ab3c-e835-4b22-b656-33f08811ecf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f43ab3c-e835-4b22-b656-33f08811ecf9', 'volume_size': 1} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:06 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c7c0a74-6448-4222-b440-f80f567e1e6b 1073741824" returned: 0 in 0.768s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:06 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b5dc4537-8526-42ed-88d9-2a982f185fa7" returned: 0 in 0.415s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-b5dc4537-8526-42ed-88d9-2a982f185fa7" released by "delete_volume" :: held 1.214s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c7c0a74-6448-4222-b440-f80f567e1e6b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:06 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c7c0a74-6448-4222-b440-f80f567e1e6b Jul 19 17:46:06 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Created reservations ['79da2d63-8f63-4830-9dc1-3740f0e7a94e', 'a1beaa94-1dc2-4b82-a15a-ccc8eec855de', 'c201e360-48fe-4a3b-8746-ed5f114745e1', 'dfa68816-ff05-41c5-af79-83120e8821fb'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:06 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:46:06 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:06 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c7c0a74-6448-4222-b440-f80f567e1e6b" returned: 0 in 0.369s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1120179641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f43ab3c-e835-4b22-b656-33f08811ecf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fb87244a814756a3e00327a4372daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:46:06Z,use_quota=True,user_id='9e5331c5a1bc4f459148cb5657f86a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d219e3c4-95a0-4250-94c9-803a65440baa),volume_type_id=d219e3c4-95a0-4250-94c9-803a65440baa)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Creating volume 9f43ab3c-e835-4b22-b656-33f08811ecf9 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:46:06 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9f43ab3c-e835-4b22-b656-33f08811ecf9 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa7a7a2-a29f-4cb5-9c72-f27cce0dd23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c7c0a74-6448-4222-b440-f80f567e1e6b', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:06 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9f43ab3c-e835-4b22-b656-33f08811ecf9 1073741824 Jul 19 17:46:06 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:06 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec68743a-6d0b-4f63-9a03-a1addb18bfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:06 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Volume volume-5c7c0a74-6448-4222-b440-f80f567e1e6b (5c7c0a74-6448-4222-b440-f80f567e1e6b): created successfully Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec68743a-6d0b-4f63-9a03-a1addb18bfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Flow 'volume_create_manager' (03a705ad-b7e4-4a4c-81d1-1058fa350256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:46:07 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f23e2bf9-480b-46b7-98ee-17f6b601eedf tempest-TestInstancesWithCinderVolumes-1114115537 None] Created volume successfully. Jul 19 17:46:07 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.416s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:46:07 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Deleted volume successfully. Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Flow 'volume_create_manager' (9488c347-275f-4c7a-a647-29a93f04879b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067c964a-374e-4092-b10c-c724e91c2783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067c964a-374e-4092-b10c-c724e91c2783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1090625590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c62e53-a24b-470f-a4df-35989a9cd720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fb87244a814756a3e00327a4372daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:46:07Z,use_quota=True,user_id='9e5331c5a1bc4f459148cb5657f86a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd957939-880d-4629-b021-c0d95b7c18cc),volume_type_id=bd957939-880d-4629-b021-c0d95b7c18cc)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e2107f-5df4-4cfc-b8d4-90f8b0bc8a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e2107f-5df4-4cfc-b8d4-90f8b0bc8a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2717a9-ff66-4e03-894b-5a3bc10b050a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.image.glance [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Creating Keystone auth plugin from conf {{(pid=87676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cd2e95bb-ebfb-46c5-988e-95d22429548d tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-b5dc4537-8526-42ed-88d9-2a982f185fa7-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-c0d0f31c-c4a3-4955-a39b-3d79e355fe5f-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-c0d0f31c-c4a3-4955-a39b-3d79e355fe5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-quobyte-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-quobyte-c0d0f31c-c4a3-4955-a39b-3d79e355fe5f" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-c0d0f31c-c4a3-4955-a39b-3d79e355fe5f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Deleting offline snapshot c0d0f31c-c4a3-4955-a39b-3d79e355fe5f of volume bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] snapshot_file for this snap is: volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:46:07 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb7c599-092f-472d-abdb-c2d5f758d561]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9f43ab3c-e835-4b22-b656-33f08811ecf9 1073741824" returned: 0 in 0.874s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9f43ab3c-e835-4b22-b656-33f08811ecf9 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2717a9-ff66-4e03-894b-5a3bc10b050a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82c62e53-a24b-470f-a4df-35989a9cd720', 'volume_name': 'volume-82c62e53-a24b-470f-a4df-35989a9cd720', 'volume_size': 1, 'image_id': '4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--396372792', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a2fb87244a814756a3e00327a4372daa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be', 'created_at': datetime.datetime(2026, 7, 19, 15, 46, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be/file', 'properties': {}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31eff9f3-9e03-4a21-8cac-cef6b8b547ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31eff9f3-9e03-4a21-8cac-cef6b8b547ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eecd90d-3f50-467d-934a-20e34a713f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:07 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Volume 82c62e53-a24b-470f-a4df-35989a9cd720: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82c62e53-a24b-470f-a4df-35989a9cd720', 'volume_size': 1, 'image_id': '4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--396372792', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a2fb87244a814756a3e00327a4372daa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be', 'created_at': datetime.datetime(2026, 7, 19, 15, 46, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be/file', 'properties': {}}, 'image_service': } Jul 19 17:46:07 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Trying to clone 82c62e53-a24b-470f-a4df-35989a9cd720 from image 4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be', 'metadata': {}}]). {{(pid=87676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 17:46:07 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9f43ab3c-e835-4b22-b656-33f08811ecf9 Jul 19 17:46:07 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:07 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f Jul 19 17:46:07 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:08 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9f43ab3c-e835-4b22-b656-33f08811ecf9" returned: 0 in 0.379s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1917fa6f-22fe-463b-b198-dab085979a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f43ab3c-e835-4b22-b656-33f08811ecf9', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbef2ed3-92d9-43b2-98b1-2280920f4125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:08 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Volume volume-9f43ab3c-e835-4b22-b656-33f08811ecf9 (9f43ab3c-e835-4b22-b656-33f08811ecf9): created successfully Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbef2ed3-92d9-43b2-98b1-2280920f4125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Flow 'volume_create_manager' (f510c1f5-886a-41d5-a416-822e13f6a782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:46:08 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-23a0ae44-3cd1-494c-906f-ecdb6ec892e2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Created volume successfully. Jul 19 17:46:08 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f" returned: 0 in 0.581s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-81d5fd26-78d9-43ad-8a2f-ff1e762f6bf1 req-b37cf56a-291f-4c03-86a5-ab7abb43cda2 tempest-TestShelveInstance-126331557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-81d5fd26-78d9-43ad-8a2f-ff1e762f6bf1 req-b37cf56a-291f-4c03-86a5-ab7abb43cda2 tempest-TestShelveInstance-126331557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8144baf2-7d11-4f1c-ab45-b2eb56f7d874]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-81d5fd26-78d9-43ad-8a2f-ff1e762f6bf1 req-b37cf56a-291f-4c03-86a5-ab7abb43cda2 tempest-TestShelveInstance-126331557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-81d5fd26-78d9-43ad-8a2f-ff1e762f6bf1 req-b37cf56a-291f-4c03-86a5-ab7abb43cda2 tempest-TestShelveInstance-126331557 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-44f41603-daba-4e6c-84b2-0f46dfac4e89', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d32d60c-8e6f-4d37-909f-a03b85f5dc76', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:46:08 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 Jul 19 17:46:08 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:08 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-81d5fd26-78d9-43ad-8a2f-ff1e762f6bf1 req-b37cf56a-291f-4c03-86a5-ab7abb43cda2 tempest-TestShelveInstance-126331557 None] attachment_update completed successfully. Jul 19 17:46:08 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8" returned: 0 in 0.468s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:08 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f Jul 19 17:46:08 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:09 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f" returned: 0 in 0.424s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:09 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f Jul 19 17:46:09 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:09 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8.c0d0f31c-c4a3-4955-a39b-3d79e355fe5f" returned: 0 in 0.313s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-c0d0f31c-c4a3-4955-a39b-3d79e355fe5f" released by "_delete_snapshot" :: held 1.944s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8" released by "delete_snapshot" :: held 1.972s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:09 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Created reservations ['940b6a55-aa8c-4c44-a9ad-3447fb5a12d6', 'ff70197a-cef7-4d03-b969-49d90177bd7e', '2e61cd82-82b4-4021-a566-45f45b8929c0', '8b9ba0bf-b8d5-4d86-9597-b890601d3a74'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:46:09 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Delete snapshot completed successfully. Jul 19 17:46:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1f2f0aa6-eaac-4b79-9e5d-8a94e1b28843 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-c0d0f31c-c4a3-4955-a39b-3d79e355fe5f-delete_snapshot" released by "delete_snapshot" :: held 2.209s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-quobyte-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8" acquired by "delete_volume" :: waited 0.034s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:11 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0def44a-f0b0-4a26-bfd7-e01eab36f3c4]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:11 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 Jul 19 17:46:11 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:11 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8" returned: 0 in 0.451s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:11 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8 Jul 19 17:46:11 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:12 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8" returned: 0 in 0.305s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8" released by "delete_volume" :: held 0.865s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:12 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Created reservations ['d5b0c851-4d64-424a-844c-ac320708c967', '8f4c3361-cf9b-431c-9c2e-65ce43b640dd', '4bf45ad3-e4d0-485b-b131-7b8c1b14d445', '4a97f7f9-ef62-4b0d-930d-9478595e3525'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:46:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:46:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:46:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:12 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:46:12 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:12 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.375s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:12 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:46:12 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Deleted volume successfully. Jul 19 17:46:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bfcc41ef-b3b0-4845-b9df-82ceb2064ab4 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-bc37694f-ad41-4502-a7b1-ed4eb9b45bb8-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Flow 'volume_create_manager' (453afcb1-3236-498d-95dd-915df84afa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3611b192-599a-4805-b92e-5d7e8c113f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3611b192-599a-4805-b92e-5d7e8c113f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1662627271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dceb2d1-89d1-4baa-b00d-75a7482dc9a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78cbcb9735c41758f82184ff495975b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:46:13Z,use_quota=True,user_id='6fe9bacd59a54dbdba38561b39c90187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4daf27-a277-4473-ad7e-cb3af9ed789b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4daf27-a277-4473-ad7e-cb3af9ed789b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d945bc-e5ba-4cc3-8a21-38ad573e4810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d945bc-e5ba-4cc3-8a21-38ad573e4810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dceb2d1-89d1-4baa-b00d-75a7482dc9a7', 'volume_name': 'volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ab3092-3e1e-4f2c-853e-3c4069a2e345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ab3092-3e1e-4f2c-853e-3c4069a2e345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4562f24f-2248-4ff8-b30f-29b3258dbd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:13 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Volume 6dceb2d1-89d1-4baa-b00d-75a7482dc9a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7', 'volume_size': 1} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1662627271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dceb2d1-89d1-4baa-b00d-75a7482dc9a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78cbcb9735c41758f82184ff495975b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:46:13Z,use_quota=True,user_id='6fe9bacd59a54dbdba38561b39c90187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Creating volume 6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:46:13 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:13 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 1073741824 Jul 19 17:46:13 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_i6ty1ck7devstack@QuobyteHD, size 20.69 MB, duration 5.76 sec {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 17:46:13 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Image download 20.69 MB at 3.59 MB/s Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[63455ccc-ba74-4648-b6fb-494d8e9b093b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_i6ty1ck7devstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:13 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 1073741824" returned: 0 in 0.693s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:13 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_i6ty1ck7devstack@QuobyteHD Jul 19 17:46:13 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:13 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 Jul 19 17:46:13 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:14 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_i6ty1ck7devstack@QuobyteHD" returned: 0 in 0.440s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Temporary image 4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be is fetched for user 9e5331c5a1bc4f459148cb5657f86a37. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 17:46:14 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7" returned: 0 in 0.350s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4562f24f-2248-4ff8-b30f-29b3258dbd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96b9534-49fd-409c-b108-a5cd22d2a28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[842048d4-1592-4721-b27b-68a97e0854f9]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_i6ty1ck7devstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:14 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Volume volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 (6dceb2d1-89d1-4baa-b00d-75a7482dc9a7): created successfully Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96b9534-49fd-409c-b108-a5cd22d2a28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Flow 'volume_create_manager' (453afcb1-3236-498d-95dd-915df84afa9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:46:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-0289e262-b66b-4911-ac14-0aedca6b718e tempest-VolumesSnapshotTestJSON-1396088549 None] Created volume successfully. Jul 19 17:46:14 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_i6ty1ck7devstack@QuobyteHD Jul 19 17:46:14 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:14 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_i6ty1ck7devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1090625590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c62e53-a24b-470f-a4df-35989a9cd720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fb87244a814756a3e00327a4372daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:46:07Z,use_quota=True,user_id='9e5331c5a1bc4f459148cb5657f86a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd957939-880d-4629-b021-c0d95b7c18cc),volume_type_id=bd957939-880d-4629-b021-c0d95b7c18cc)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Creating volume 82c62e53-a24b-470f-a4df-35989a9cd720 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:46:14 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:46:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:14 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720 1073741824 Jul 19 17:46:14 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:15 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720 1073741824" returned: 0 in 0.735s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:15 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720 Jul 19 17:46:15 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:16 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720" returned: 0 in 0.546s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:46:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.556s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] Creating offline snapshot a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 of volume 6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:46:16 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Attempting download of 4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be ((None, [{'url': 'file:///opt/stack/data/glance/images/4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be', 'metadata': {}}])) to volume 82c62e53-a24b-470f-a4df-35989a9cd720. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 17:46:16 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fa3f1a-7534-4f41-ae12-f4c25c3f9211]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:16 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f72c65-9982-4568-ae68-0845d3717442]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_40cts4qn {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:16 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 Jul 19 17:46:16 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:16 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_40cts4qn Jul 19 17:46:16 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:17 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_40cts4qn" returned: 0 in 0.823s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_40cts4qn {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:17 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7" returned: 0 in 1.071s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:17 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_40cts4qn Jul 19 17:46:17 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:17 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 1G Jul 19 17:46:17 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:18 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_40cts4qn" returned: 1 in 0.782s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_40cts4qn' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:46:18 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a3e283-a91e-49ee-9300-e5cac818b580]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_i6ty1ck7devstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:18 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_i6ty1ck7devstack@QuobyteHD Jul 19 17:46:18 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:18 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 1G" returned: 0 in 1.056s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:18 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 Jul 19 17:46:18 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:18 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_i6ty1ck7devstack@QuobyteHD" returned: 0 in 0.860s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:18 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] 4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be was qcow2, converting to qcow2 {{(pid=87676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 17:46:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_i6ty1ck7devstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:18 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_i6ty1ck7devstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720 Jul 19 17:46:18 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:19 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7" returned: 0 in 0.661s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:19 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 is being set with open permissions: ugo+rw Jul 19 17:46:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:19 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 Jul 19 17:46:19 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:19 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7" returned: 0 in 0.420s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:19 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.info Jul 19 17:46:19 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:19 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.info" returned: 0 in 0.324s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:19 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.info is being set with open permissions: ugo+rw Jul 19 17:46:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:19 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.info Jul 19 17:46:19 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:20 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.info" returned: 0 in 0.367s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.075s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:20 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-e253eb72-8624-404e-8d79-6087019e8135 tempest-VolumesSnapshotTestJSON-1396088549 None] Create snapshot completed successfully Jul 19 17:46:21 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_i6ty1ck7devstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720" returned: 0 in 2.684s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:21 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be_i6ty1ck7devstack@QuobyteHD, size 112.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:46:21 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Converted 112.00 MB image at 41.72 MB/s Jul 19 17:46:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:21 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720 1G Jul 19 17:46:21 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:21 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:46:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Flow 'volume_create_manager' (2909e2b2-0a58-4844-adba-1c1122073002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:46:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f14ec42-d6f4-4260-892a-9fe69c9860b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f14ec42-d6f4-4260-892a-9fe69c9860b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-400135702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76cae3a-63b8-45e3-a977-3540026376e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78cbcb9735c41758f82184ff495975b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4af578d-dd4b-44d7-91d5-b5aa198fc0d7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:46:22Z,use_quota=True,user_id='6fe9bacd59a54dbdba38561b39c90187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5628224c-f17b-4059-b445-2549e8f6ffec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5628224c-f17b-4059-b445-2549e8f6ffec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cda93cc-f321-47f4-b63d-59cfac5acc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cda93cc-f321-47f4-b63d-59cfac5acc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b76cae3a-63b8-45e3-a977-3540026376e6', 'volume_name': 'volume-b76cae3a-63b8-45e3-a977-3540026376e6', 'volume_size': 1, 'snapshot_id': 'a4af578d-dd4b-44d7-91d5-b5aa198fc0d7'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986079fb-418e-486a-9a5d-79ae918b93c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986079fb-418e-486a-9a5d-79ae918b93c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8190908d-77c0-43cf-8db3-0296697eed6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:21 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Volume b76cae3a-63b8-45e3-a977-3540026376e6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b76cae3a-63b8-45e3-a977-3540026376e6', 'volume_size': 1, 'snapshot_id': 'a4af578d-dd4b-44d7-91d5-b5aa198fc0d7'} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-quobyte-a4af578d-dd4b-44d7-91d5-b5aa198fc0d7-b76cae3a-63b8-45e3-a977-3540026376e6" by "_create_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-a4af578d-dd4b-44d7-91d5-b5aa198fc0d7-b76cae3a-63b8-45e3-a977-3540026376e6" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Creating volume b76cae3a-63b8-45e3-a977-3540026376e6 from snapshot a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 {{(pid=87676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:46:22 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-quobyte-b76cae3a-63b8-45e3-a977-3540026376e6" by "_copy_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720 1G" returned: 0 in 0.435s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Downloaded image 4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be ((None, [{'url': 'file:///opt/stack/data/glance/images/4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be', 'metadata': {}}])) to volume 82c62e53-a24b-470f-a4df-35989a9cd720 successfully. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Temporary image 4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be for user 9e5331c5a1bc4f459148cb5657f86a37 is deleted. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Marking volume 82c62e53-a24b-470f-a4df-35989a9cd720 as bootable. {{(pid=87676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-b76cae3a-63b8-45e3-a977-3540026376e6" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] snapshot: a4af578d-dd4b-44d7-91d5-b5aa198fc0d7, volume: b76cae3a-63b8-45e3-a977-3540026376e6, {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Copying metadata from image 4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be to 82c62e53-a24b-470f-a4df-35989a9cd720. {{(pid=87676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Creating volume glance metadata for volume 82c62e53-a24b-470f-a4df-35989a9cd720 backed by image 4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be with: {'image_id': '4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be', 'image_name': 'tempest-scenario-img--396372792', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a16dcb2-9f8b-4b09-9982-d402383f9772]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eecd90d-3f50-467d-934a-20e34a713f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82c62e53-a24b-470f-a4df-35989a9cd720', 'volume_size': 1, 'image_id': '4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--396372792', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a2fb87244a814756a3e00327a4372daa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be', 'created_at': datetime.datetime(2026, 7, 19, 15, 46, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 46, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ad7d2ea-89fd-4ce3-996a-3c674b0cc4be/file', 'properties': {}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e6acb4-a041-4605-ab73-d420b3052786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:22 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Volume volume-82c62e53-a24b-470f-a4df-35989a9cd720 (82c62e53-a24b-470f-a4df-35989a9cd720): created successfully Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e6acb4-a041-4605-ab73-d420b3052786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Flow 'volume_create_manager' (9488c347-275f-4c7a-a647-29a93f04879b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:46:22 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-d4b5744b-e55e-4ecc-bc51-6a54f19a931f tempest-TestInstancesWithCinderVolumes-1114115537 None] Created volume successfully. Jul 19 17:46:22 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 Jul 19 17:46:22 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:22 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7" returned: 0 in 0.584s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] will copy from snapshot at /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Creating direct copy from snapshot {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df846a4-dc1f-4b09-be34-528dc0ffcdca]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:22 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 Jul 19 17:46:22 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:23 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7" returned: 0 in 0.410s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:23 devstack cinder-volume[87676]: DEBUG cinder.utils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Path /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b76cae3a-63b8-45e3-a977-3540026376e6 not found in is_blk_device check {{(pid=87676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 17:46:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b76cae3a-63b8-45e3-a977-3540026376e6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:23 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b76cae3a-63b8-45e3-a977-3540026376e6 Jul 19 17:46:23 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-b5e7490c-6cfc-4ff4-bed9-dfd268e13a14 req-019448dc-0f51-4a0e-9484-3645c7c170a2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:31 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b76cae3a-63b8-45e3-a977-3540026376e6" returned: 0 in 8.136s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:31 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b898ad-663f-4345-8b28-d5ef593caee3]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:31 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 Jul 19 17:46:31 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:32 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7" returned: 0 in 0.812s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:32 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Image conversion details: src /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7, size 1024.00 MB, duration 8.14 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b76cae3a-63b8-45e3-a977-3540026376e6 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:46:32 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Converted 1024.00 MB image at 125.84 MB/s Jul 19 17:46:32 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b76cae3a-63b8-45e3-a977-3540026376e6 is being set with open permissions: ugo+rw Jul 19 17:46:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b76cae3a-63b8-45e3-a977-3540026376e6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:32 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b76cae3a-63b8-45e3-a977-3540026376e6 Jul 19 17:46:32 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:32 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b76cae3a-63b8-45e3-a977-3540026376e6" returned: 0 in 0.408s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-b76cae3a-63b8-45e3-a977-3540026376e6" released by "_copy_volume_from_snapshot" :: held 10.522s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-a4af578d-dd4b-44d7-91d5-b5aa198fc0d7-b76cae3a-63b8-45e3-a977-3540026376e6" released by "_create_volume_from_snapshot" :: held 10.583s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.607s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-b5e7490c-6cfc-4ff4-bed9-dfd268e13a14 req-019448dc-0f51-4a0e-9484-3645c7c170a2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.284s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-b5e7490c-6cfc-4ff4-bed9-dfd268e13a14 req-019448dc-0f51-4a0e-9484-3645c7c170a2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8190908d-77c0-43cf-8db3-0296697eed6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b76cae3a-63b8-45e3-a977-3540026376e6', 'volume_size': 1, 'snapshot_id': 'a4af578d-dd4b-44d7-91d5-b5aa198fc0d7'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c44c9e4-8f86-4a23-940d-dbf433b52612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:32 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Volume volume-b76cae3a-63b8-45e3-a977-3540026376e6 (b76cae3a-63b8-45e3-a977-3540026376e6): created successfully Jul 19 17:46:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c44c9e4-8f86-4a23-940d-dbf433b52612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Flow 'volume_create_manager' (2909e2b2-0a58-4844-adba-1c1122073002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:46:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-b5e7490c-6cfc-4ff4-bed9-dfd268e13a14 req-019448dc-0f51-4a0e-9484-3645c7c170a2 tempest-TestInstancesWithCinderVolumes-1114115537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-82c62e53-a24b-470f-a4df-35989a9cd720', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f847361-27cb-40cd-a776-e95e89105a17', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:46:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9f073c88-80bd-4b0e-bd67-5105c467e8ac tempest-VolumesSnapshotTestJSON-1396088549 None] Created volume successfully. Jul 19 17:46:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-b5e7490c-6cfc-4ff4-bed9-dfd268e13a14 req-019448dc-0f51-4a0e-9484-3645c7c170a2 tempest-TestInstancesWithCinderVolumes-1114115537 None] attachment_update completed successfully. Jul 19 17:46:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-b76cae3a-63b8-45e3-a977-3540026376e6-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-b76cae3a-63b8-45e3-a977-3540026376e6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-quobyte-b76cae3a-63b8-45e3-a977-3540026376e6" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-b76cae3a-63b8-45e3-a977-3540026376e6" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:34 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fac75d-1f30-4b1b-a2d0-a82792833886]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b76cae3a-63b8-45e3-a977-3540026376e6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:34 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b76cae3a-63b8-45e3-a977-3540026376e6 Jul 19 17:46:34 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:34 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b76cae3a-63b8-45e3-a977-3540026376e6" returned: 0 in 0.543s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b76cae3a-63b8-45e3-a977-3540026376e6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:34 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b76cae3a-63b8-45e3-a977-3540026376e6 Jul 19 17:46:34 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:46:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:35 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:46:35 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:35 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b76cae3a-63b8-45e3-a977-3540026376e6" returned: 0 in 0.448s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-b76cae3a-63b8-45e3-a977-3540026376e6" released by "delete_volume" :: held 1.063s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Created reservations ['093f7f31-1ad2-40a4-863f-d98851eea911', '135befd0-6376-4a05-bb8e-45b842bd2706', 'b6c2a134-581a-48d7-99bb-12238b8d43cc', '5a089d34-584f-4928-9e7e-06fea79100e7'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:35 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:46:35 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:35 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.494s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 28 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:46:35 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.306s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:46:35 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Deleted volume successfully. Jul 19 17:46:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c9685775-23f6-4197-a89a-06c6df2a4dbf tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-b76cae3a-63b8-45e3-a977-3540026376e6-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-a4af578d-dd4b-44d7-91d5-b5aa198fc0d7-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-a4af578d-dd4b-44d7-91d5-b5aa198fc0d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-quobyte-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-quobyte-a4af578d-dd4b-44d7-91d5-b5aa198fc0d7" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-a4af578d-dd4b-44d7-91d5-b5aa198fc0d7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Deleting offline snapshot a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 of volume 6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:46:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] snapshot_file for this snap is: volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:46:36 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[855e6876-3333-497b-9032-3294c1bc5be9]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:36 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 Jul 19 17:46:36 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:36 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7" returned: 0 in 0.470s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:46:36 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bf84fd-1043-4701-b2a1-ab2362e68bfa]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:37 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 Jul 19 17:46:37 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:37 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7" returned: 0 in 0.399s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:37 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 Jul 19 17:46:37 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:37 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7" returned: 0 in 0.595s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:37 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7 Jul 19 17:46:37 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:38 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7.a4af578d-dd4b-44d7-91d5-b5aa198fc0d7" returned: 0 in 0.392s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-a4af578d-dd4b-44d7-91d5-b5aa198fc0d7" released by "_delete_snapshot" :: held 2.054s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7" released by "delete_snapshot" :: held 2.096s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:38 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Created reservations ['01697eb0-ee4f-4937-800b-c34322cf8809', '428e905a-95ce-49f9-bcb5-d70345fb0d06', 'cf6b615e-67ce-4d19-86d9-e4315527a32c', '9292d2b5-d1c5-4173-a565-9fe91bbdd37a'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:46:38 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Delete snapshot completed successfully. Jul 19 17:46:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4e3d7692-b60e-4ba9-9fe8-ead551d4915a tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-a4af578d-dd4b-44d7-91d5-b5aa198fc0d7-delete_snapshot" released by "delete_snapshot" :: held 2.538s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-quobyte-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7" acquired by "delete_volume" :: waited 0.051s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:39 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9904553-60dc-4918-bbe4-24bdffe5ab9b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:40 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 Jul 19 17:46:40 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:40 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7" returned: 0 in 0.522s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:40 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7 Jul 19 17:46:40 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:40 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7" returned: 0 in 0.326s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7" released by "delete_volume" :: held 0.988s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:40 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Created reservations ['5f6c9022-11e4-4371-a3ac-7ff3d7f8e362', '671d1d17-f34c-4e95-a302-597ba230c8bc', 'e95268ea-cf72-4c85-b9a0-9ad796525da3', '594f8d50-c9fe-4504-9c35-f2485b23a870'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:46:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:41 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:46:41 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:46:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:41 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:46:41 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:41 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.516s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:41 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:46:41 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Deleted volume successfully. Jul 19 17:46:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6ab195e6-8b87-4912-a0d5-fbc0c53d4ad4 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-6dceb2d1-89d1-4baa-b00d-75a7482dc9a7-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-4efa6684-5c37-4ffe-8311-4c9a009f0455-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-4efa6684-5c37-4ffe-8311-4c9a009f0455-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "cinder-quobyte-4efa6684-5c37-4ffe-8311-4c9a009f0455" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:46:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-4efa6684-5c37-4ffe-8311-4c9a009f0455" acquired by "delete_volume" :: waited 0.034s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:46:42 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f530bd86-0c26-4d12-bec9-063d0eb7c41f]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:42 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 Jul 19 17:46:42 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:43 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455" returned: 0 in 0.812s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:43 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455 Jul 19 17:46:43 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:43 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4efa6684-5c37-4ffe-8311-4c9a009f0455" returned: 0 in 0.504s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:43 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-quobyte-4efa6684-5c37-4ffe-8311-4c9a009f0455" released by "delete_volume" :: held 1.456s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:43 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Created reservations ['ba75381a-ad6a-4452-9ba3-4c01aedd4832', '467634f5-e3cd-499b-bb47-9a87d026c329', 'f51d359e-fa23-4415-97b4-88edfe002f44', 'e4d173f4-d11b-403c-bf0d-a5b920816ed1'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:46:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:46:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:46:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:44 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:46:44 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:44 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.460s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:44 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:46:44 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Deleted volume successfully. Jul 19 17:46:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-16893328-3a5c-485a-803b-ad7fe1956849 tempest-VolumesSnapshotTestJSON-1396088549 None] Lock "cinder-4efa6684-5c37-4ffe-8311-4c9a009f0455-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:46:54 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:UPDATE=69,cinder:SELECT=65,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:46:54 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:DELETE=5,cinder:UPDATE=76,cinder:SELECT=75,cinder:INSERT=20 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Flow 'volume_create_manager' (fd7867e6-038b-4f4b-b1bf-45479de850a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132e8c3c-110a-49c3-83d9-e553adacb2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132e8c3c-110a-49c3-83d9-e553adacb2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1554808976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9361b98e-a701-4543-9386-7f3053894aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9ba8236e7a47bcbccc45d72c4f866d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:46:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:46:56Z,use_quota=True,user_id='22cb2f2ac77f4f03bc2639d43b978008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed91c60-9f49-444d-9e62-511703f4ce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed91c60-9f49-444d-9e62-511703f4ce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec10ef3-3715-4b45-a6a6-3a0127cdf2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec10ef3-3715-4b45-a6a6-3a0127cdf2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9361b98e-a701-4543-9386-7f3053894aa2', 'volume_name': 'volume-9361b98e-a701-4543-9386-7f3053894aa2', 'volume_size': 2}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f82daf4-571e-43cf-9643-c05fa94312eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f82daf4-571e-43cf-9643-c05fa94312eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9575ce2c-9dbb-4d70-ba19-b20bbd7cc8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:56 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Volume 9361b98e-a701-4543-9386-7f3053894aa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9361b98e-a701-4543-9386-7f3053894aa2', 'volume_size': 2} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1554808976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9361b98e-a701-4543-9386-7f3053894aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9ba8236e7a47bcbccc45d72c4f866d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:46:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:46:56Z,use_quota=True,user_id='22cb2f2ac77f4f03bc2639d43b978008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Creating volume 9361b98e-a701-4543-9386-7f3053894aa2 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:46:56 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2 2147483648 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:56 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2 2147483648 Jul 19 17:46:56 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:56 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2 2147483648" returned: 0 in 0.619s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:57 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2 Jul 19 17:46:57 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:57 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2" returned: 0 in 0.346s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:46:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:46:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9575ce2c-9dbb-4d70-ba19-b20bbd7cc8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9361b98e-a701-4543-9386-7f3053894aa2', 'volume_size': 2}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e1ba65-3127-4e86-b47c-486c1562aa77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:46:57 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Volume volume-9361b98e-a701-4543-9386-7f3053894aa2 (9361b98e-a701-4543-9386-7f3053894aa2): created successfully Jul 19 17:46:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e1ba65-3127-4e86-b47c-486c1562aa77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:46:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Flow 'volume_create_manager' (fd7867e6-038b-4f4b-b1bf-45479de850a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:46:57 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-95beaa89-ec71-4c10-999d-8df210743d36 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Created volume successfully. Jul 19 17:46:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:46:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:46:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Creating offline snapshot cd767d86-1412-4843-86a0-c16b4831a943 of volume 9361b98e-a701-4543-9386-7f3053894aa2 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:46:58 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c3c27b-6225-4e9c-bb1b-6d3db4311304]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:46:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:59 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2 Jul 19 17:46:59 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:46:59 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Jul 19 17:46:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2" returned: 0 in 0.674s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:46:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943 2G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:46:59 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943 2G Jul 19 17:46:59 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:00 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943 2G" returned: 0 in 0.537s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9361b98e-a701-4543-9386-7f3053894aa2 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:00 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9361b98e-a701-4543-9386-7f3053894aa2 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943 Jul 19 17:47:00 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:00 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-38d74d87-265e-480d-9db9-923166270d78 req-fe7e2538-a5bd-4d03-9994-635dfb92cc1b tempest-TestShelveInstance-126331557 None] Terminate volume connection completed successfully. Jul 19 17:47:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-38d74d87-265e-480d-9db9-923166270d78 req-fe7e2538-a5bd-4d03-9994-635dfb92cc1b tempest-TestShelveInstance-126331557 None] Deleting attachment 0d32d60c-8e6f-4d37-909f-a03b85f5dc76. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:47:00 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9361b98e-a701-4543-9386-7f3053894aa2 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943" returned: 0 in 0.400s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:00 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943 is being set with open permissions: ugo+rw Jul 19 17:47:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:00 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943 Jul 19 17:47:00 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Acquiring lock "cinder-44f41603-daba-4e6c-84b2-0f46dfac4e89-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Lock "cinder-44f41603-daba-4e6c-84b2-0f46dfac4e89-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Acquiring lock "cinder-quobyte-44f41603-daba-4e6c-84b2-0f46dfac4e89" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Lock "cinder-quobyte-44f41603-daba-4e6c-84b2-0f46dfac4e89" acquired by "delete_volume" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:00 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3143bbd5-d176-4643-8091-a823fc460dbe]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:00 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943" returned: 0 in 0.311s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:00 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.info Jul 19 17:47:00 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:00 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89 Jul 19 17:47:00 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:01 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89" returned: 0 in 0.492s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:01 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.info" returned: 0 in 0.432s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:01 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.info is being set with open permissions: ugo+rw Jul 19 17:47:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:01 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89 Jul 19 17:47:01 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:01 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.info Jul 19 17:47:01 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:01 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.info" returned: 0 in 0.289s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:01 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.763s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-44f41603-daba-4e6c-84b2-0f46dfac4e89" returned: 0 in 0.340s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Lock "cinder-quobyte-44f41603-daba-4e6c-84b2-0f46dfac4e89" released by "delete_volume" :: held 0.894s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:01 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-d73cc583-f16d-48c0-a406-b282f818e804 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Create snapshot completed successfully Jul 19 17:47:01 devstack cinder-volume[87676]: DEBUG cinder.quota [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Created reservations ['94105550-c732-49fa-9d49-d385198ba41e', 'e065f5ac-bf09-42e2-9f6c-aa4c6d767c3c', '6b5c00f2-5a4e-404b-9e0d-196220b00941', '0c2b25f8-54fa-4502-a142-7e4f33fb71e3'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:47:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:01 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:47:01 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:02 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.304s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG cinder.manager [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:47:02 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Deleted volume successfully. Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Acquiring lock "cinder-cd767d86-1412-4843-86a0-c16b4831a943-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [req-38d74d87-265e-480d-9db9-923166270d78 req-d3ea459a-0267-4753-a8fb-44293a99b1f3 tempest-TestShelveInstance-126331557 None] Lock "cinder-44f41603-daba-4e6c-84b2-0f46dfac4e89-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "cinder-cd767d86-1412-4843-86a0-c16b4831a943-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Acquiring lock "cinder-quobyte-9361b98e-a701-4543-9386-7f3053894aa2" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "cinder-quobyte-9361b98e-a701-4543-9386-7f3053894aa2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Acquiring lock "cinder-quobyte-cd767d86-1412-4843-86a0-c16b4831a943" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "cinder-quobyte-cd767d86-1412-4843-86a0-c16b4831a943" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Deleting offline snapshot cd767d86-1412-4843-86a0-c16b4831a943 of volume 9361b98e-a701-4543-9386-7f3053894aa2 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] snapshot_file for this snap is: volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b044c04-8fcc-471c-99af-ecd42c615b56]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:02 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943 Jul 19 17:47:02 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:02 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943" returned: 0 in 0.432s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9361b98e-a701-4543-9386-7f3053894aa2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7a72ff-ac91-4743-882d-38aaca4849fd]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:02 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2 Jul 19 17:47:02 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:03 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2" returned: 0 in 0.405s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:03 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943 Jul 19 17:47:03 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:03 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943" returned: 0 in 0.388s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:03 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943 Jul 19 17:47:03 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:03 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2.cd767d86-1412-4843-86a0-c16b4831a943" returned: 0 in 0.319s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "cinder-quobyte-cd767d86-1412-4843-86a0-c16b4831a943" released by "_delete_snapshot" :: held 1.660s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "cinder-quobyte-9361b98e-a701-4543-9386-7f3053894aa2" released by "delete_snapshot" :: held 1.682s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:03 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Created reservations ['27a42414-fd83-427b-a691-a2121e61d20d', '799d3ac4-61c4-40a8-a9ef-6d1ba647c1e7', '35aae507-d86d-4807-bd95-9bd70d2cab13', '94b1cbab-5707-4d12-80f1-1024279bff32'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:47:04 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Delete snapshot completed successfully. Jul 19 17:47:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f946bae7-a3e9-4d31-8ff4-e97b9909bca6 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "cinder-cd767d86-1412-4843-86a0-c16b4831a943-delete_snapshot" released by "delete_snapshot" :: held 1.830s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Acquiring lock "cinder-9361b98e-a701-4543-9386-7f3053894aa2-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "cinder-9361b98e-a701-4543-9386-7f3053894aa2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Acquiring lock "cinder-quobyte-9361b98e-a701-4543-9386-7f3053894aa2" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "cinder-quobyte-9361b98e-a701-4543-9386-7f3053894aa2" acquired by "delete_volume" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:04 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27d39d3-d3d8-48fe-bf1c-1c9e8850514d]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:04 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2 Jul 19 17:47:04 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:04 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2" returned: 0 in 0.399s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:05 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2 Jul 19 17:47:05 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:05 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9361b98e-a701-4543-9386-7f3053894aa2" returned: 0 in 0.310s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "cinder-quobyte-9361b98e-a701-4543-9386-7f3053894aa2" released by "delete_volume" :: held 0.798s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:05 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Created reservations ['77064e4f-a98d-40a0-ba7f-7a469598db54', 'd0fae1a4-91f1-4e9c-b759-d47a9482fb2f', '46d19207-30a6-4334-8223-4ade49427ad1', '656dbd78-07ca-4c55-b75c-825274f45dcb'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:47:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:05 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:47:05 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:05 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.320s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:05 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:47:05 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Deleted volume successfully. Jul 19 17:47:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-23d6b7ef-dbbb-4e26-9fe6-ac1960c318a0 tempest-VolumesSnapshotNegativeTestJSON-1101420748 None] Lock "cinder-9361b98e-a701-4543-9386-7f3053894aa2-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Flow 'volume_create_manager' (90c0dbe9-ee79-46e3-a2cb-013e7d4db89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621e422a-a3a9-4d89-9137-20bf321dea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621e422a-a3a9-4d89-9137-20bf321dea53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1990946260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3b07cd-8850-474c-af76-94dd9a9e729b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7543b09b0516407c9b55234e8605b28d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:47:09Z,use_quota=True,user_id='1cc3e3d60a6b436cbbb54942859e5103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56fe220-e7f9-479f-9908-2092590c2598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56fe220-e7f9-479f-9908-2092590c2598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a077d0ac-b498-402a-9321-93c7001ee26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a077d0ac-b498-402a-9321-93c7001ee26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a3b07cd-8850-474c-af76-94dd9a9e729b', 'volume_name': 'volume-8a3b07cd-8850-474c-af76-94dd9a9e729b', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6246183c-8e78-405a-a365-29bff822f92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6246183c-8e78-405a-a365-29bff822f92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf32732c-0808-41eb-9782-1e264e00395f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:09 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Volume 8a3b07cd-8850-474c-af76-94dd9a9e729b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a3b07cd-8850-474c-af76-94dd9a9e729b', 'volume_size': 1} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1990946260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3b07cd-8850-474c-af76-94dd9a9e729b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7543b09b0516407c9b55234e8605b28d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:47:09Z,use_quota=True,user_id='1cc3e3d60a6b436cbbb54942859e5103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Creating volume 8a3b07cd-8850-474c-af76-94dd9a9e729b {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:47:09 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-d8c9c6ac-992b-491a-ba2d-1325be1cebf6 req-fedce885-a80f-4148-8bab-9b0664dbdbf0 tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:09 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b 1073741824 Jul 19 17:47:09 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:10 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b 1073741824" returned: 0 in 0.523s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:10 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b Jul 19 17:47:10 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:10 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b" returned: 0 in 0.275s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:47:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-d8c9c6ac-992b-491a-ba2d-1325be1cebf6 req-fedce885-a80f-4148-8bab-9b0664dbdbf0 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.807s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf32732c-0808-41eb-9782-1e264e00395f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3b07cd-8850-474c-af76-94dd9a9e729b', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500635ba-688b-4796-b8b1-cc42897fd074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-d8c9c6ac-992b-491a-ba2d-1325be1cebf6 req-fedce885-a80f-4148-8bab-9b0664dbdbf0 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:10 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Volume volume-8a3b07cd-8850-474c-af76-94dd9a9e729b (8a3b07cd-8850-474c-af76-94dd9a9e729b): created successfully Jul 19 17:47:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500635ba-688b-4796-b8b1-cc42897fd074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Flow 'volume_create_manager' (90c0dbe9-ee79-46e3-a2cb-013e7d4db89b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:47:10 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-423b70f9-45b2-4b13-8b1b-f9ee30024c53 tempest-VolumeDependencyTests-1315068959 None] Created volume successfully. Jul 19 17:47:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-d8c9c6ac-992b-491a-ba2d-1325be1cebf6 req-fedce885-a80f-4148-8bab-9b0664dbdbf0 tempest-TestInstancesWithCinderVolumes-1114115537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-5c7c0a74-6448-4222-b440-f80f567e1e6b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83b43c63-b034-47a9-8f7d-d810c7948d8b', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:47:10 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-d8c9c6ac-992b-491a-ba2d-1325be1cebf6 req-fedce885-a80f-4148-8bab-9b0664dbdbf0 tempest-TestInstancesWithCinderVolumes-1114115537 None] attachment_update completed successfully. Jul 19 17:47:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] Creating offline snapshot 51345e8e-302f-4864-af14-c365cc4eddc9 of volume 8a3b07cd-8850-474c-af76-94dd9a9e729b {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:47:11 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[823605be-6f41-4785-b0db-44b7fb9535ac]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:11 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b Jul 19 17:47:11 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:12 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b" returned: 0 in 0.464s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:12 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 1G Jul 19 17:47:12 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:12 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 1G" returned: 0 in 0.478s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a3b07cd-8850-474c-af76-94dd9a9e729b -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-b4c52203-842e-4d3c-aa5a-140a29e926ce req-854ff99c-a0c2-4e27-8769-8338f930f236 tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:12 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a3b07cd-8850-474c-af76-94dd9a9e729b -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 Jul 19 17:47:12 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:13 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a3b07cd-8850-474c-af76-94dd9a9e729b -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9" returned: 0 in 0.336s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:13 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 is being set with open permissions: ugo+rw Jul 19 17:47:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:13 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 Jul 19 17:47:13 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:13 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9" returned: 0 in 0.256s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:13 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.info Jul 19 17:47:13 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:13 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.info" returned: 0 in 0.346s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:13 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.info is being set with open permissions: ugo+rw Jul 19 17:47:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:13 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.info Jul 19 17:47:13 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:13 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.info" returned: 0 in 0.290s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.268s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-b4c52203-842e-4d3c-aa5a-140a29e926ce req-854ff99c-a0c2-4e27-8769-8338f930f236 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.254s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-b4c52203-842e-4d3c-aa5a-140a29e926ce req-854ff99c-a0c2-4e27-8769-8338f930f236 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-dd942a49-5cab-4b69-aa18-ee9ed90f5302 tempest-VolumeDependencyTests-1315068959 None] Create snapshot completed successfully Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-b4c52203-842e-4d3c-aa5a-140a29e926ce req-854ff99c-a0c2-4e27-8769-8338f930f236 tempest-TestInstancesWithCinderVolumes-1114115537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-9f43ab3c-e835-4b22-b656-33f08811ecf9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7fb94943-a7a9-4f1c-853e-461ff9bf2708', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:47:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-b4c52203-842e-4d3c-aa5a-140a29e926ce req-854ff99c-a0c2-4e27-8769-8338f930f236 tempest-TestInstancesWithCinderVolumes-1114115537 None] attachment_update completed successfully. Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Flow 'volume_create_manager' (814aa1bd-258f-4275-9270-8e164a095a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71cd3ee-be4e-4403-bfc9-ab6a1fd42101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71cd3ee-be4e-4403-bfc9-ab6a1fd42101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1227627786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27154e62-def1-43cc-bd8a-5bb36a0722fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7e447fa61f4239980482ee9921a8a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:47:15Z,use_quota=True,user_id='341114491f8c4f3c87f62db879df2cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f103c2c-39e1-420a-8e98-95ec66fc0027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f103c2c-39e1-420a-8e98-95ec66fc0027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b86c342-6d2b-466e-9612-d92725b794ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b86c342-6d2b-466e-9612-d92725b794ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27154e62-def1-43cc-bd8a-5bb36a0722fd', 'volume_name': 'volume-27154e62-def1-43cc-bd8a-5bb36a0722fd', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db8ae87-fe00-40f2-a1c0-e3e8fc8e28f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db8ae87-fe00-40f2-a1c0-e3e8fc8e28f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891127a0-445c-4b53-ba79-4e4271e2caea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:14 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Volume 27154e62-def1-43cc-bd8a-5bb36a0722fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27154e62-def1-43cc-bd8a-5bb36a0722fd', 'volume_size': 1} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1227627786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27154e62-def1-43cc-bd8a-5bb36a0722fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7e447fa61f4239980482ee9921a8a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:47:15Z,use_quota=True,user_id='341114491f8c4f3c87f62db879df2cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Creating volume 27154e62-def1-43cc-bd8a-5bb36a0722fd {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:47:14 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:47:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-27154e62-def1-43cc-bd8a-5bb36a0722fd 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:14 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-27154e62-def1-43cc-bd8a-5bb36a0722fd 1073741824 Jul 19 17:47:14 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:15 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-27154e62-def1-43cc-bd8a-5bb36a0722fd 1073741824" returned: 0 in 0.490s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-27154e62-def1-43cc-bd8a-5bb36a0722fd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:15 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-27154e62-def1-43cc-bd8a-5bb36a0722fd Jul 19 17:47:15 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Flow 'volume_create_manager' (4a3d76cd-7a18-4dc8-a4d8-060d29cc0278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bf72e1-4445-47aa-811f-fdaf46cdfce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bf72e1-4445-47aa-811f-fdaf46cdfce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-555246356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa7ba767-e3e8-4453-87e2-7bd883cc08e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7543b09b0516407c9b55234e8605b28d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=51345e8e-302f-4864-af14-c365cc4eddc9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:47:15Z,use_quota=True,user_id='1cc3e3d60a6b436cbbb54942859e5103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4ed70f-2932-4bd5-95b0-91d953eb5bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4ed70f-2932-4bd5-95b0-91d953eb5bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8216f8f-a005-4661-acf7-70e23e906198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8216f8f-a005-4661-acf7-70e23e906198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa7ba767-e3e8-4453-87e2-7bd883cc08e6', 'volume_name': 'volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6', 'volume_size': 1, 'snapshot_id': '51345e8e-302f-4864-af14-c365cc4eddc9'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d991e6c1-b8cf-4b1f-9e37-b0726df9bda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d991e6c1-b8cf-4b1f-9e37-b0726df9bda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e035ab3b-7341-4f51-bd38-ecce04302700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:15 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Volume aa7ba767-e3e8-4453-87e2-7bd883cc08e6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6', 'volume_size': 1, 'snapshot_id': '51345e8e-302f-4864-af14-c365cc4eddc9'} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:15 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-27154e62-def1-43cc-bd8a-5bb36a0722fd" returned: 0 in 0.271s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.118s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "cinder-quobyte-51345e8e-302f-4864-af14-c365cc4eddc9-aa7ba767-e3e8-4453-87e2-7bd883cc08e6" by "_create_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891127a0-445c-4b53-ba79-4e4271e2caea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27154e62-def1-43cc-bd8a-5bb36a0722fd', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9991ed-028b-41ff-9412-bad19b21e85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-quobyte-51345e8e-302f-4864-af14-c365cc4eddc9-aa7ba767-e3e8-4453-87e2-7bd883cc08e6" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Creating volume aa7ba767-e3e8-4453-87e2-7bd883cc08e6 from snapshot 51345e8e-302f-4864-af14-c365cc4eddc9 {{(pid=87676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "cinder-quobyte-aa7ba767-e3e8-4453-87e2-7bd883cc08e6" by "_copy_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:15 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Volume volume-27154e62-def1-43cc-bd8a-5bb36a0722fd (27154e62-def1-43cc-bd8a-5bb36a0722fd): created successfully Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9991ed-028b-41ff-9412-bad19b21e85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Flow 'volume_create_manager' (814aa1bd-258f-4275-9270-8e164a095a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-quobyte-aa7ba767-e3e8-4453-87e2-7bd883cc08e6" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] snapshot: 51345e8e-302f-4864-af14-c365cc4eddc9, volume: aa7ba767-e3e8-4453-87e2-7bd883cc08e6, {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 17:47:15 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ece6f795-62d2-445e-866f-41a427fbcdb2 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Created volume successfully. Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe4e926-8db0-419f-879a-674264339b8d]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:16 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 Jul 19 17:47:16 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:16 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9" returned: 0 in 0.429s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a3b07cd-8850-474c-af76-94dd9a9e729b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:47:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] will copy from snapshot at /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 17:47:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Creating direct copy from snapshot {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 17:47:16 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[956ce099-29f5-4ea9-8439-e9593dbb7eb8]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:16 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b Jul 19 17:47:16 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:16 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b" returned: 0 in 0.433s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:16 devstack cinder-volume[87676]: DEBUG cinder.utils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Path /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6 not found in is_blk_device check {{(pid=87676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 17:47:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:16 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6 Jul 19 17:47:16 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-3e9cf1d7-ec0d-413f-8d99-3db0577d3689 req-9803df0c-efe6-4a45-912d-60fa8f1df068 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:22 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-65e46821-fe21-40ba-adb3-e7056fb18348 req-3f8b0d56-b811-4ae5-8f77-03d406ee3c18 tempest-TestInstancesWithCinderVolumes-1114115537 None] Terminate volume connection completed successfully. Jul 19 17:47:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-65e46821-fe21-40ba-adb3-e7056fb18348 req-3f8b0d56-b811-4ae5-8f77-03d406ee3c18 tempest-TestInstancesWithCinderVolumes-1114115537 None] Deleting attachment 83b43c63-b034-47a9-8f7d-d810c7948d8b. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:47:22 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6" returned: 0 in 6.072s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:22 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[73608434-7045-41af-8b2f-955ff00af3e6]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:23 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b Jul 19 17:47:23 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:23 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b" returned: 0 in 0.552s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Image conversion details: src /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:47:23 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Converted 1024.00 MB image at 168.61 MB/s Jul 19 17:47:23 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6 is being set with open permissions: ugo+rw Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:23 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6 Jul 19 17:47:23 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "cinder-5c7c0a74-6448-4222-b440-f80f567e1e6b-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "cinder-5c7c0a74-6448-4222-b440-f80f567e1e6b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "cinder-quobyte-5c7c0a74-6448-4222-b440-f80f567e1e6b" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:23 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6" returned: 0 in 0.265s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "cinder-quobyte-5c7c0a74-6448-4222-b440-f80f567e1e6b" acquired by "delete_volume" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-quobyte-aa7ba767-e3e8-4453-87e2-7bd883cc08e6" released by "_copy_volume_from_snapshot" :: held 7.894s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-quobyte-51345e8e-302f-4864-af14-c365cc4eddc9-aa7ba767-e3e8-4453-87e2-7bd883cc08e6" released by "_create_volume_from_snapshot" :: held 7.960s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-3e9cf1d7-ec0d-413f-8d99-3db0577d3689 req-9803df0c-efe6-4a45-912d-60fa8f1df068 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.052s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[621ba8d1-639c-4cdf-b870-78430a23deb6]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c7c0a74-6448-4222-b440-f80f567e1e6b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-3e9cf1d7-ec0d-413f-8d99-3db0577d3689 req-9803df0c-efe6-4a45-912d-60fa8f1df068 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e035ab3b-7341-4f51-bd38-ecce04302700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6', 'volume_size': 1, 'snapshot_id': '51345e8e-302f-4864-af14-c365cc4eddc9'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6addec3b-67fc-4038-83d7-79ab6574c8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:23 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Volume volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6 (aa7ba767-e3e8-4453-87e2-7bd883cc08e6): created successfully Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6addec3b-67fc-4038-83d7-79ab6574c8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Flow 'volume_create_manager' (4a3d76cd-7a18-4dc8-a4d8-060d29cc0278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:47:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-3e9cf1d7-ec0d-413f-8d99-3db0577d3689 req-9803df0c-efe6-4a45-912d-60fa8f1df068 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-27154e62-def1-43cc-bd8a-5bb36a0722fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db7ca19d-810c-4127-8fd5-7c69f45cba60', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:47:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9a1927e4-e5d2-4e1e-b3b0-cbdb8b1d57d4 tempest-VolumeDependencyTests-1315068959 None] Created volume successfully. Jul 19 17:47:23 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c7c0a74-6448-4222-b440-f80f567e1e6b Jul 19 17:47:23 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-3e9cf1d7-ec0d-413f-8d99-3db0577d3689 req-9803df0c-efe6-4a45-912d-60fa8f1df068 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] attachment_update completed successfully. Jul 19 17:47:24 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c7c0a74-6448-4222-b440-f80f567e1e6b" returned: 0 in 0.650s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c7c0a74-6448-4222-b440-f80f567e1e6b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:24 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c7c0a74-6448-4222-b440-f80f567e1e6b Jul 19 17:47:24 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "cinder-51345e8e-302f-4864-af14-c365cc4eddc9-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-51345e8e-302f-4864-af14-c365cc4eddc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "cinder-quobyte-8a3b07cd-8850-474c-af76-94dd9a9e729b" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-quobyte-8a3b07cd-8850-474c-af76-94dd9a9e729b" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "cinder-quobyte-51345e8e-302f-4864-af14-c365cc4eddc9" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-quobyte-51345e8e-302f-4864-af14-c365cc4eddc9" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Deleting offline snapshot 51345e8e-302f-4864-af14-c365cc4eddc9 of volume 8a3b07cd-8850-474c-af76-94dd9a9e729b {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:47:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] snapshot_file for this snap is: volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:47:24 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[578909a9-4cb2-4598-94f6-24a86bd25c67]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:24 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c7c0a74-6448-4222-b440-f80f567e1e6b" returned: 0 in 0.554s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "cinder-quobyte-5c7c0a74-6448-4222-b440-f80f567e1e6b" released by "delete_volume" :: held 1.284s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:25 devstack cinder-volume[87676]: WARNING cinder.quota [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-78783736-953195970 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-78783736-953195970, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:47:25 devstack cinder-volume[87676]: WARNING cinder.quota [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-78783736-953195970 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-78783736-953195970, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:47:25 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 Jul 19 17:47:25 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:25 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Created reservations ['eb143ef2-2561-42cb-8ad7-ce1f60e74aa4', 'ebfbfb0e-0652-4d67-bdac-7914a263141d', 'cfa13e67-2118-445e-8c2f-9d02d8200d00', '65071a2a-32e6-406c-875a-b4ffe085aadd'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:47:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:25 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:47:25 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:25 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9" returned: 0 in 0.585s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a3b07cd-8850-474c-af76-94dd9a9e729b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:47:25 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ec30bf-ace9-4d07-94a0-7d0e9ec221f8]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:25 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.567s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:25 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:47:25 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Deleted volume successfully. Jul 19 17:47:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b08da19c-a83b-40eb-b6c5-302cdcbbfe0c tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "cinder-5c7c0a74-6448-4222-b440-f80f567e1e6b-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:25 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b Jul 19 17:47:25 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:26 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b" returned: 0 in 0.604s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:26 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 Jul 19 17:47:26 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:26 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9" returned: 0 in 0.605s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:26 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9 Jul 19 17:47:26 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:27 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b.51345e8e-302f-4864-af14-c365cc4eddc9" returned: 0 in 0.402s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-quobyte-51345e8e-302f-4864-af14-c365cc4eddc9" released by "_delete_snapshot" :: held 2.405s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-quobyte-8a3b07cd-8850-474c-af76-94dd9a9e729b" released by "delete_snapshot" :: held 2.449s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:27 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Created reservations ['a92f3039-0565-483a-a1ce-f5efa9e235be', 'bc9f5c97-c062-4a47-aa44-d88c9a6157b5', 'ce511ffc-9293-4e60-9576-e41240bdbe8b', '7bd729df-30b3-4fce-9970-129218e66779'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:47:27 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Delete snapshot completed successfully. Jul 19 17:47:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b5163dac-809c-4977-a35e-2e192f8c59ad tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-51345e8e-302f-4864-af14-c365cc4eddc9-delete_snapshot" released by "delete_snapshot" :: held 2.715s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:27 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-3dd78764-a097-4eb7-842d-fb1fcec558d3 req-f4aa86e9-4859-4cf5-a1b5-345d067fc8a6 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Terminate volume connection completed successfully. Jul 19 17:47:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-3dd78764-a097-4eb7-842d-fb1fcec558d3 req-f4aa86e9-4859-4cf5-a1b5-345d067fc8a6 tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Deleting attachment db7ca19d-810c-4127-8fd5-7c69f45cba60. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "cinder-8a3b07cd-8850-474c-af76-94dd9a9e729b-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-8a3b07cd-8850-474c-af76-94dd9a9e729b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "cinder-quobyte-8a3b07cd-8850-474c-af76-94dd9a9e729b" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-quobyte-8a3b07cd-8850-474c-af76-94dd9a9e729b" acquired by "delete_volume" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c440ed-2def-4178-9779-d4a9d9da56ef]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:28 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b Jul 19 17:47:28 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:28 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-37714c10-b3b5-496f-a9ed-57dfa9e7f44d req-cb791ab6-3f55-446a-a476-f7735126c4a1 tempest-TestInstancesWithCinderVolumes-1114115537 None] Terminate volume connection completed successfully. Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-37714c10-b3b5-496f-a9ed-57dfa9e7f44d req-cb791ab6-3f55-446a-a476-f7735126c4a1 tempest-TestInstancesWithCinderVolumes-1114115537 None] Deleting attachment 7fb94943-a7a9-4f1c-853e-461ff9bf2708. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Acquiring lock "cinder-27154e62-def1-43cc-bd8a-5bb36a0722fd-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Lock "cinder-27154e62-def1-43cc-bd8a-5bb36a0722fd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Acquiring lock "cinder-quobyte-27154e62-def1-43cc-bd8a-5bb36a0722fd" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Lock "cinder-quobyte-27154e62-def1-43cc-bd8a-5bb36a0722fd" acquired by "delete_volume" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[27abc66e-ae5f-4270-85b3-b69ac14e7a41]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-27154e62-def1-43cc-bd8a-5bb36a0722fd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:28 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b" returned: 0 in 0.475s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:28 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b Jul 19 17:47:28 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:28 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-27154e62-def1-43cc-bd8a-5bb36a0722fd Jul 19 17:47:28 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:28 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8a3b07cd-8850-474c-af76-94dd9a9e729b" returned: 0 in 0.279s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-quobyte-8a3b07cd-8850-474c-af76-94dd9a9e729b" released by "delete_volume" :: held 0.831s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Created reservations ['13307845-15e8-420d-aa12-c420765531b1', 'f896d037-d4d5-412e-8254-abe6f62d31f2', '0e1cb89c-488a-499e-8a01-044bdb0a5c3c', '6acdf162-4477-4548-bab4-096d611b83dc'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:47:29 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-27154e62-def1-43cc-bd8a-5bb36a0722fd" returned: 0 in 0.441s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-27154e62-def1-43cc-bd8a-5bb36a0722fd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:29 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-27154e62-def1-43cc-bd8a-5bb36a0722fd Jul 19 17:47:29 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "cinder-9f43ab3c-e835-4b22-b656-33f08811ecf9-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "cinder-9f43ab3c-e835-4b22-b656-33f08811ecf9-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:29 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:47:29 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "cinder-aa7ba767-e3e8-4453-87e2-7bd883cc08e6-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "cinder-quobyte-9f43ab3c-e835-4b22-b656-33f08811ecf9" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "cinder-quobyte-9f43ab3c-e835-4b22-b656-33f08811ecf9" acquired by "delete_volume" :: waited 0.050s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-aa7ba767-e3e8-4453-87e2-7bd883cc08e6-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5eeda6-2614-43e1-955e-534d35e71f1c]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9f43ab3c-e835-4b22-b656-33f08811ecf9 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:29 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-27154e62-def1-43cc-bd8a-5bb36a0722fd" returned: 0 in 0.399s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "cinder-quobyte-aa7ba767-e3e8-4453-87e2-7bd883cc08e6" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Lock "cinder-quobyte-27154e62-def1-43cc-bd8a-5bb36a0722fd" released by "delete_volume" :: held 0.920s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-quobyte-aa7ba767-e3e8-4453-87e2-7bd883cc08e6" acquired by "delete_volume" :: waited 0.043s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:29 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9f43ab3c-e835-4b22-b656-33f08811ecf9 Jul 19 17:47:29 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[212f8557-2085-418d-9f5d-23b1e6b68693]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Created reservations ['adc60a54-bbbd-4ed6-9b56-04455eb42749', 'f2c1d4a4-af02-4e46-8499-7e3b1da87722', '25b2a56c-1b65-40f9-8405-f4e6fc783f66', 'e08922c2-c85f-4929-8298-6c804b0a4291'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:47:29 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.517s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:47:29 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Deleted volume successfully. Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac410314-5871-45fa-8224-f47d1c502f8c tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-8a3b07cd-8850-474c-af76-94dd9a9e729b-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:29 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6 Jul 19 17:47:29 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:29 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:47:29 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:30 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9f43ab3c-e835-4b22-b656-33f08811ecf9" returned: 0 in 0.738s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9f43ab3c-e835-4b22-b656-33f08811ecf9 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:30 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6" returned: 0 in 0.623s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:30 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9f43ab3c-e835-4b22-b656-33f08811ecf9 Jul 19 17:47:30 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:30 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6 Jul 19 17:47:30 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:30 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.518s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:47:30 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Deleted volume successfully. Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ceccc87f-f3f3-4fc7-b7a6-fd6eab81611f tempest-TestServerVolumeAttachScenarioOldVersion-313921551 None] Lock "cinder-27154e62-def1-43cc-bd8a-5bb36a0722fd-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:30 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aa7ba767-e3e8-4453-87e2-7bd883cc08e6" returned: 0 in 0.390s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:30 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-quobyte-aa7ba767-e3e8-4453-87e2-7bd883cc08e6" released by "delete_volume" :: held 1.072s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9f43ab3c-e835-4b22-b656-33f08811ecf9" returned: 0 in 0.447s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "cinder-quobyte-9f43ab3c-e835-4b22-b656-33f08811ecf9" released by "delete_volume" :: held 1.262s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:30 devstack cinder-volume[87676]: WARNING cinder.quota [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1611026857-1810963890 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1611026857-1810963890, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:47:30 devstack cinder-volume[87676]: WARNING cinder.quota [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1611026857-1810963890 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1611026857-1810963890, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Created reservations ['500a1fc0-d2ac-4579-9211-2b11fdaa9318', '1625b02a-5bfc-4c88-8915-be83bb494ca9', '2867e691-fea9-4a36-8a15-1bfc7bd5ff39', '39125a23-47f1-4d4c-b938-0886d6f016db'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Created reservations ['ce58d6f9-a261-48a8-b08b-64e62e5dfc99', '0518024e-9635-48ab-a2b7-679c75443d25', '814e4e99-ab65-44c5-8cd2-8891af16d769', '2488e343-b516-4acf-b8a5-9eb5415a728a'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:30 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:47:30 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:30 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:47:30 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:31 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.438s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:31 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:31 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:47:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.391s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:31 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:47:31 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Deleted volume successfully. Jul 19 17:47:31 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f372b31e-ec4c-4359-837d-61f0793db875 tempest-VolumeDependencyTests-1315068959 None] Lock "cinder-aa7ba767-e3e8-4453-87e2-7bd883cc08e6-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:31 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Deleted volume successfully. Jul 19 17:47:31 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6072b3df-96af-4210-a2af-3b518a3d8577 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "cinder-9f43ab3c-e835-4b22-b656-33f08811ecf9-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:47:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:35 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:47:35 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:35 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.416s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:47:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:47:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 29 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:47:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:47:36 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-656c37c7-5aa5-40cd-a205-db4ad2e108ef req-fb4d0c7a-3de6-459f-be1b-69c1ce502f8c tempest-TestInstancesWithCinderVolumes-1114115537 None] Terminate volume connection completed successfully. Jul 19 17:47:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-656c37c7-5aa5-40cd-a205-db4ad2e108ef req-fb4d0c7a-3de6-459f-be1b-69c1ce502f8c tempest-TestInstancesWithCinderVolumes-1114115537 None] Deleting attachment 8f847361-27cb-40cd-a776-e95e89105a17. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:47:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "cinder-82c62e53-a24b-470f-a4df-35989a9cd720-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "cinder-82c62e53-a24b-470f-a4df-35989a9cd720-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "cinder-quobyte-82c62e53-a24b-470f-a4df-35989a9cd720" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "cinder-quobyte-82c62e53-a24b-470f-a4df-35989a9cd720" acquired by "delete_volume" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:38 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70cdb77-84c9-41d3-a05d-42175af02b23]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:38 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720 Jul 19 17:47:38 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:38 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720" returned: 0 in 0.422s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:38 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720 Jul 19 17:47:38 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:39 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-82c62e53-a24b-470f-a4df-35989a9cd720" returned: 0 in 0.600s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "cinder-quobyte-82c62e53-a24b-470f-a4df-35989a9cd720" released by "delete_volume" :: held 1.087s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:39 devstack cinder-volume[87676]: WARNING cinder.quota [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-577141078-1440574422 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-577141078-1440574422, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:47:39 devstack cinder-volume[87676]: WARNING cinder.quota [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-577141078-1440574422 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-577141078-1440574422, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:47:39 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Created reservations ['fe8cb85d-75f2-48eb-9302-fda3c6e19b0f', '61c53c58-bc62-47b9-ab15-7e9ca3054433', 'a8e423fb-3eb1-4477-a804-0c11edc64152', '7351faff-f905-4628-b0d6-a750003216c8'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:47:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:39 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:47:39 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:39 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.361s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:39 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:47:39 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Deleted volume successfully. Jul 19 17:47:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-69b7c462-7c76-4372-bc16-175bb2b9c362 tempest-TestInstancesWithCinderVolumes-1114115537 None] Lock "cinder-82c62e53-a24b-470f-a4df-35989a9cd720-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:40 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:47:41 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Flow 'volume_create_manager' (783383d5-3779-490d-9bf6-f2d07b260101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:47:41 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff03cab-ebd2-42de-8583-79b7592fdfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:41 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff03cab-ebd2-42de-8583-79b7592fdfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c50e8b-ba03-4679-9ee3-0fdcdfd202de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942393ce8e224d48a4edd0a83ade38dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:47:41Z,use_quota=True,user_id='f56d78c396c841508a80458eb3159eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:41 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef2751b-6204-4401-9603-c41bc7de436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:41 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef2751b-6204-4401-9603-c41bc7de436e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:41 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fd0f1b-3d7e-4924-820b-6339c3eec388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:41 devstack cinder-volume[87676]: DEBUG cinder.image.glance [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Creating Keystone auth plugin from conf {{(pid=87676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 17:47:41 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fd0f1b-3d7e-4924-820b-6339c3eec388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '37c50e8b-ba03-4679-9ee3-0fdcdfd202de', 'volume_name': 'volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de', 'volume_size': 1, 'image_id': 'a59c402d-db33-4e07-bf44-616ee979d372', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a59c402d-db33-4e07-bf44-616ee979d372', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f974abca396e0440db74a8e0cb1b6214', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '942393ce8e224d48a4edd0a83ade38dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff84229071a730def3103bdc572c9991c784241aa6363b5049c8e25e82af427a5be2d63cf52ecf92f2f9be253afd1d709e26d2eb083f9455da382fe573742e01', 'id': 'a59c402d-db33-4e07-bf44-616ee979d372', 'created_at': datetime.datetime(2026, 7, 19, 15, 47, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 47, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a59c402d-db33-4e07-bf44-616ee979d372/file', 'properties': {}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:41 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd55ffae-6009-4167-9e43-59458a61f442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:41 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd55ffae-6009-4167-9e43-59458a61f442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:41 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed090362-56f7-4033-b8fa-14aa09072303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:41 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Volume 37c50e8b-ba03-4679-9ee3-0fdcdfd202de: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de', 'volume_size': 1, 'image_id': 'a59c402d-db33-4e07-bf44-616ee979d372', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a59c402d-db33-4e07-bf44-616ee979d372', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f974abca396e0440db74a8e0cb1b6214', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '942393ce8e224d48a4edd0a83ade38dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff84229071a730def3103bdc572c9991c784241aa6363b5049c8e25e82af427a5be2d63cf52ecf92f2f9be253afd1d709e26d2eb083f9455da382fe573742e01', 'id': 'a59c402d-db33-4e07-bf44-616ee979d372', 'created_at': datetime.datetime(2026, 7, 19, 15, 47, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 47, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a59c402d-db33-4e07-bf44-616ee979d372/file', 'properties': {}}, 'image_service': } Jul 19 17:47:41 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Trying to clone 37c50e8b-ba03-4679-9ee3-0fdcdfd202de from image a59c402d-db33-4e07-bf44-616ee979d372 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a59c402d-db33-4e07-bf44-616ee979d372', 'metadata': {}}]). {{(pid=87676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 17:47:41 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 17:47:41 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Image download 0.00 MB at 0.00 MB/s Jul 19 17:47:41 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[135edf14-0809-4f39-81e1-9436f5dbe6cc]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:41 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD Jul 19 17:47:41 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:42 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:42 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD Jul 19 17:47:42 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:42 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD" returned: 1 in 0.519s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:47:42 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Temporary image a59c402d-db33-4e07-bf44-616ee979d372 is fetched for user f56d78c396c841508a80458eb3159eee. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 17:47:42 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfa3e87-093b-492c-91b6-166a0d585f7f]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:43 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD Jul 19 17:47:43 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:43 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:43 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD Jul 19 17:47:43 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:43 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:47:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c50e8b-ba03-4679-9ee3-0fdcdfd202de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942393ce8e224d48a4edd0a83ade38dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:47:41Z,use_quota=True,user_id='f56d78c396c841508a80458eb3159eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:47:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Creating volume 37c50e8b-ba03-4679-9ee3-0fdcdfd202de {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:47:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:47:43 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:47:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:43 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de 1073741824 Jul 19 17:47:43 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:44 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de 1073741824" returned: 0 in 0.659s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:44 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de Jul 19 17:47:44 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:44 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de" returned: 0 in 0.332s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:47:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:44 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Attempting download of a59c402d-db33-4e07-bf44-616ee979d372 ((None, [{'url': 'file:///opt/stack/data/glance/images/a59c402d-db33-4e07-bf44-616ee979d372', 'metadata': {}}])) to volume 37c50e8b-ba03-4679-9ee3-0fdcdfd202de. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 17:47:44 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[29055dbe-e60e-4ce4-93e2-9c5534757d07]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a59c402d-db33-4e07-bf44-616ee979d372_gcpz35fk {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:45 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a59c402d-db33-4e07-bf44-616ee979d372_gcpz35fk Jul 19 17:47:45 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:45 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a59c402d-db33-4e07-bf44-616ee979d372_gcpz35fk" returned: 0 in 0.462s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a59c402d-db33-4e07-bf44-616ee979d372_gcpz35fk {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:45 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a59c402d-db33-4e07-bf44-616ee979d372_gcpz35fk Jul 19 17:47:45 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:45 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a59c402d-db33-4e07-bf44-616ee979d372_gcpz35fk" returned: 1 in 0.375s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a59c402d-db33-4e07-bf44-616ee979d372_gcpz35fk' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:47:45 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff3f162-ea18-449c-a839-f618ecc241b6]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:45 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD Jul 19 17:47:45 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:46 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:46 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD Jul 19 17:47:46 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:46 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD" returned: 1 in 0.488s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:47:46 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] a59c402d-db33-4e07-bf44-616ee979d372 was raw, converting to qcow2 {{(pid=87676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 17:47:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:46 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de Jul 19 17:47:46 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:47 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de" returned: 0 in 0.555s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:47 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a59c402d-db33-4e07-bf44-616ee979d372_l5l3nn4idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:47:47 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Converted 0.00 MB image at 0.00 MB/s Jul 19 17:47:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:47 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de 1G Jul 19 17:47:47 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:47 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de 1G" returned: 0 in 0.392s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:47 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Downloaded image a59c402d-db33-4e07-bf44-616ee979d372 ((None, [{'url': 'file:///opt/stack/data/glance/images/a59c402d-db33-4e07-bf44-616ee979d372', 'metadata': {}}])) to volume 37c50e8b-ba03-4679-9ee3-0fdcdfd202de successfully. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 17:47:47 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Temporary image a59c402d-db33-4e07-bf44-616ee979d372 for user f56d78c396c841508a80458eb3159eee is deleted. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 17:47:47 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Marking volume 37c50e8b-ba03-4679-9ee3-0fdcdfd202de as bootable. {{(pid=87676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 17:47:47 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Copying metadata from image a59c402d-db33-4e07-bf44-616ee979d372 to 37c50e8b-ba03-4679-9ee3-0fdcdfd202de. {{(pid=87676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 17:47:47 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Creating volume glance metadata for volume 37c50e8b-ba03-4679-9ee3-0fdcdfd202de backed by image a59c402d-db33-4e07-bf44-616ee979d372 with: {'image_id': 'a59c402d-db33-4e07-bf44-616ee979d372', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f974abca396e0440db74a8e0cb1b6214', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 17:47:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed090362-56f7-4033-b8fa-14aa09072303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de', 'volume_size': 1, 'image_id': 'a59c402d-db33-4e07-bf44-616ee979d372', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a59c402d-db33-4e07-bf44-616ee979d372', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f974abca396e0440db74a8e0cb1b6214', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '942393ce8e224d48a4edd0a83ade38dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff84229071a730def3103bdc572c9991c784241aa6363b5049c8e25e82af427a5be2d63cf52ecf92f2f9be253afd1d709e26d2eb083f9455da382fe573742e01', 'id': 'a59c402d-db33-4e07-bf44-616ee979d372', 'created_at': datetime.datetime(2026, 7, 19, 15, 47, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 47, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a59c402d-db33-4e07-bf44-616ee979d372/file', 'properties': {}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeecd959-e8af-4e16-a631-53a426f8a409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:47 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Volume volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de (37c50e8b-ba03-4679-9ee3-0fdcdfd202de): created successfully Jul 19 17:47:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeecd959-e8af-4e16-a631-53a426f8a409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Flow 'volume_create_manager' (783383d5-3779-490d-9bf6-f2d07b260101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:47:47 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ef2fa325-4b40-49b4-a5bc-c895e1a3c6bf tempest-VolumeImageDependencyTests-246281819 None] Created volume successfully. Jul 19 17:47:48 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Acquiring lock "cinder-37c50e8b-ba03-4679-9ee3-0fdcdfd202de-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:48 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Lock "cinder-37c50e8b-ba03-4679-9ee3-0fdcdfd202de-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:48 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Acquiring lock "cinder-quobyte-37c50e8b-ba03-4679-9ee3-0fdcdfd202de" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:47:48 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Lock "cinder-quobyte-37c50e8b-ba03-4679-9ee3-0fdcdfd202de" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:47:48 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a61079-2611-49db-bd40-06cc3de3e037]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:47:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:48 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de Jul 19 17:47:48 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:49 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de" returned: 0 in 0.414s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:49 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de Jul 19 17:47:49 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:49 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-37c50e8b-ba03-4679-9ee3-0fdcdfd202de" returned: 0 in 0.307s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Lock "cinder-quobyte-37c50e8b-ba03-4679-9ee3-0fdcdfd202de" released by "delete_volume" :: held 0.776s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:49 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Created reservations ['7cafb798-3311-427e-a414-6e60de3ab1d2', '1455f4a8-4bf5-4a44-866e-427dc7d339ba', '188f0980-6a02-4f2d-b613-07d1c1bad9b0', '1260b0e8-53f5-4126-8fda-39c268bd3748'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:47:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:49 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:47:49 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:49 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.290s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:49 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:47:49 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Deleted volume successfully. Jul 19 17:47:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3df15b2a-1eee-4320-8d2d-755f750f37b1 tempest-VolumeImageDependencyTests-246281819 None] Lock "cinder-37c50e8b-ba03-4679-9ee3-0fdcdfd202de-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Flow 'volume_create_manager' (ce7b46b6-045a-4664-9e13-ac64e5556881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82e6299-6ad1-4038-bef2-5e927b7c92ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82e6299-6ad1-4038-bef2-5e927b7c92ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-175981461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dfec182-6f50-41a1-adac-9c53b8add333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d6d7668fb54f399faf25bf6f17efee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:47:51Z,use_quota=True,user_id='be9a87939794404cb9db814bc63062fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ced331d-4475-499f-ba8e-cb29ad023268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ced331d-4475-499f-ba8e-cb29ad023268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be8ee18-2dee-4c60-ae7b-ae87779555b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be8ee18-2dee-4c60-ae7b-ae87779555b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dfec182-6f50-41a1-adac-9c53b8add333', 'volume_name': 'volume-3dfec182-6f50-41a1-adac-9c53b8add333', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf92216-a467-4030-a3a4-9c007e666b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf92216-a467-4030-a3a4-9c007e666b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fca3b9-705f-46f3-bfd8-eebbaa673492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:51 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Volume 3dfec182-6f50-41a1-adac-9c53b8add333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dfec182-6f50-41a1-adac-9c53b8add333', 'volume_size': 1} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-175981461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dfec182-6f50-41a1-adac-9c53b8add333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d6d7668fb54f399faf25bf6f17efee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:47:51Z,use_quota=True,user_id='be9a87939794404cb9db814bc63062fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Creating volume 3dfec182-6f50-41a1-adac-9c53b8add333 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:47:51 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:51 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 1073741824 Jul 19 17:47:51 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:51 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 1073741824" returned: 0 in 0.560s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:51 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 Jul 19 17:47:51 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:52 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333" returned: 0 in 0.303s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:47:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fca3b9-705f-46f3-bfd8-eebbaa673492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dfec182-6f50-41a1-adac-9c53b8add333', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e150af70-a719-445d-8839-1dd5a70bce9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:52 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Volume volume-3dfec182-6f50-41a1-adac-9c53b8add333 (3dfec182-6f50-41a1-adac-9c53b8add333): created successfully Jul 19 17:47:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e150af70-a719-445d-8839-1dd5a70bce9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Flow 'volume_create_manager' (ce7b46b6-045a-4664-9e13-ac64e5556881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:47:52 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-4e56efac-93dc-4f71-b5b7-a9d2df821698 tempest-TestStampPattern-2100490008 None] Created volume successfully. Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:UPDATE=114,cinder:SELECT=103,cinder:INSERT=31,cinder:DELETE=9 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=109,cinder:INSERT=29,cinder:UPDATE=105,cinder:DELETE=8 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Flow 'volume_create_manager' (73ced004-877d-494d-90cb-bdf9f7eff8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (708c00b7-492e-4773-bdc2-2ef94cee1094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (708c00b7-492e-4773-bdc2-2ef94cee1094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d65dafd-522e-49de-8078-3591e015fb89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55df6bbd95bd4bdabccec32ed984f2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:47:55Z,use_quota=True,user_id='a179a28f30fc44e6a59204b8a465a381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80751f9c-4677-4a26-ae48-8960988ac3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80751f9c-4677-4a26-ae48-8960988ac3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d235ab2-b23f-4629-92b2-938145bbf58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d235ab2-b23f-4629-92b2-938145bbf58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d65dafd-522e-49de-8078-3591e015fb89', 'volume_name': 'volume-7d65dafd-522e-49de-8078-3591e015fb89', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a5a5ef-696c-4db0-8c43-918e631b6673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a5a5ef-696c-4db0-8c43-918e631b6673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635e08d2-1a6d-4295-aa65-3e46041e4534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:55 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Volume 7d65dafd-522e-49de-8078-3591e015fb89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d65dafd-522e-49de-8078-3591e015fb89', 'volume_size': 1} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d65dafd-522e-49de-8078-3591e015fb89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55df6bbd95bd4bdabccec32ed984f2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:47:55Z,use_quota=True,user_id='a179a28f30fc44e6a59204b8a465a381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Creating volume 7d65dafd-522e-49de-8078-3591e015fb89 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:47:55 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:47:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7d65dafd-522e-49de-8078-3591e015fb89 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:55 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7d65dafd-522e-49de-8078-3591e015fb89 1073741824 Jul 19 17:47:55 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:56 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7d65dafd-522e-49de-8078-3591e015fb89 1073741824" returned: 0 in 0.782s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7d65dafd-522e-49de-8078-3591e015fb89 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:56 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7d65dafd-522e-49de-8078-3591e015fb89 Jul 19 17:47:56 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:56 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7d65dafd-522e-49de-8078-3591e015fb89" returned: 0 in 0.378s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:47:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635e08d2-1a6d-4295-aa65-3e46041e4534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d65dafd-522e-49de-8078-3591e015fb89', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a566da-43e8-4f58-bf2a-b68075b33125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:56 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Volume volume-7d65dafd-522e-49de-8078-3591e015fb89 (7d65dafd-522e-49de-8078-3591e015fb89): created successfully Jul 19 17:47:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a566da-43e8-4f58-bf2a-b68075b33125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:56 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Flow 'volume_create_manager' (73ced004-877d-494d-90cb-bdf9f7eff8b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:47:56 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-686b5872-8224-446c-8764-b02ab479bd9e tempest-CinderUnicodeTest-1291835972 None] Created volume successfully. Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Flow 'volume_create_manager' (3899eea8-d089-45f5-a8a0-b11de106501b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d73e30-104c-4637-9947-a3855ad0f1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d73e30-104c-4637-9947-a3855ad0f1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:47:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-704799468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25348e6d-2c9d-49c6-b3af-bd000aea0922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55df6bbd95bd4bdabccec32ed984f2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:47:58Z,use_quota=True,user_id='a179a28f30fc44e6a59204b8a465a381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ace41e9-de39-4203-b874-4c4eacdf9506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ace41e9-de39-4203-b874-4c4eacdf9506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62932d8-c76a-4915-a3aa-07f583327e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62932d8-c76a-4915-a3aa-07f583327e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25348e6d-2c9d-49c6-b3af-bd000aea0922', 'volume_name': 'volume-25348e6d-2c9d-49c6-b3af-bd000aea0922', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e779bf-3e8c-4b27-a7cf-8e3c9288ef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e779bf-3e8c-4b27-a7cf-8e3c9288ef14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c417401b-4d9b-4b90-a68d-c30faf9dd301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:58 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Volume 25348e6d-2c9d-49c6-b3af-bd000aea0922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25348e6d-2c9d-49c6-b3af-bd000aea0922', 'volume_size': 1} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:47:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-704799468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25348e6d-2c9d-49c6-b3af-bd000aea0922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55df6bbd95bd4bdabccec32ed984f2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:47:58Z,use_quota=True,user_id='a179a28f30fc44e6a59204b8a465a381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Creating volume 25348e6d-2c9d-49c6-b3af-bd000aea0922 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:47:58 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:47:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:58 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 1073741824 Jul 19 17:47:58 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:59 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 1073741824" returned: 0 in 0.579s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:47:59 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 Jul 19 17:47:59 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:47:59 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Jul 19 17:47:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922" returned: 0 in 0.310s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:47:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:47:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:47:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c417401b-4d9b-4b90-a68d-c30faf9dd301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25348e6d-2c9d-49c6-b3af-bd000aea0922', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f73f17d3-5075-4501-8c4a-9a86388ee249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:47:59 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Volume volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 (25348e6d-2c9d-49c6-b3af-bd000aea0922): created successfully Jul 19 17:47:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f73f17d3-5075-4501-8c4a-9a86388ee249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:47:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Flow 'volume_create_manager' (3899eea8-d089-45f5-a8a0-b11de106501b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:47:59 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9abef8f1-10dd-4179-9e86-53002e5c7755 tempest-CinderUnicodeTest-1291835972 None] Created volume successfully. Jul 19 17:48:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:48:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:48:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] Creating offline snapshot 1da78f9f-4012-45c2-b1a3-8068c936d40a of volume 25348e6d-2c9d-49c6-b3af-bd000aea0922 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:48:00 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[67711976-df44-4ebf-88e8-6d45c124027c]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:48:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:00 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 Jul 19 17:48:00 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:01 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922" returned: 0 in 0.457s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:01 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a 1G Jul 19 17:48:01 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:01 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a 1G" returned: 0 in 0.459s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:01 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a Jul 19 17:48:01 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:01 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a" returned: 0 in 0.431s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:01 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a is being set with open permissions: ugo+rw Jul 19 17:48:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:02 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a Jul 19 17:48:02 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:02 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a" returned: 0 in 0.294s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:02 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.info Jul 19 17:48:02 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:02 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.info" returned: 0 in 0.279s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:02 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.info is being set with open permissions: ugo+rw Jul 19 17:48:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:02 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.info Jul 19 17:48:02 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:02 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.info" returned: 0 in 0.257s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.289s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:48:02 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a52278d4-f6ad-403d-b063-832d2adc5da7 tempest-CinderUnicodeTest-1291835972 None] Create snapshot completed successfully Jul 19 17:48:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Acquiring lock "cinder-1da78f9f-4012-45c2-b1a3-8068c936d40a-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:48:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Lock "cinder-1da78f9f-4012-45c2-b1a3-8068c936d40a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:48:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Acquiring lock "cinder-quobyte-25348e6d-2c9d-49c6-b3af-bd000aea0922" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:48:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Lock "cinder-quobyte-25348e6d-2c9d-49c6-b3af-bd000aea0922" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:48:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Acquiring lock "cinder-quobyte-1da78f9f-4012-45c2-b1a3-8068c936d40a" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:48:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Lock "cinder-quobyte-1da78f9f-4012-45c2-b1a3-8068c936d40a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:48:03 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Deleting offline snapshot 1da78f9f-4012-45c2-b1a3-8068c936d40a of volume 25348e6d-2c9d-49c6-b3af-bd000aea0922 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:48:03 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] snapshot_file for this snap is: volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:48:03 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f61120-d78b-4934-8c00-c60346ab54b6]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:48:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:04 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a Jul 19 17:48:04 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:04 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a" returned: 0 in 0.444s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25348e6d-2c9d-49c6-b3af-bd000aea0922(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:48:04 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc34a3c-a834-483a-86c5-5da79fd2294c]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:48:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:04 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 Jul 19 17:48:04 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:04 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922" returned: 0 in 0.525s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:04 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a Jul 19 17:48:04 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:05 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a" returned: 0 in 0.594s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:05 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a Jul 19 17:48:05 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:06 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922.1da78f9f-4012-45c2-b1a3-8068c936d40a" returned: 0 in 0.517s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Lock "cinder-quobyte-1da78f9f-4012-45c2-b1a3-8068c936d40a" released by "_delete_snapshot" :: held 2.254s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:48:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Lock "cinder-quobyte-25348e6d-2c9d-49c6-b3af-bd000aea0922" released by "delete_snapshot" :: held 2.304s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:48:06 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Created reservations ['4803e4ca-3d2e-4a6d-a15b-6bd591e2d1f5', '2fe41f49-bbca-499a-89c6-c781a65100a2', '5a60a638-3368-4422-acd1-211205ce2048', '986737d2-4a49-4840-b993-9d902a5f143e'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:48:06 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Delete snapshot completed successfully. Jul 19 17:48:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-04d6f65b-693d-4199-a5c2-87d69dba4c58 tempest-CinderUnicodeTest-1291835972 None] Lock "cinder-1da78f9f-4012-45c2-b1a3-8068c936d40a-delete_snapshot" released by "delete_snapshot" :: held 2.584s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:48:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Acquiring lock "cinder-25348e6d-2c9d-49c6-b3af-bd000aea0922-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:48:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Lock "cinder-25348e6d-2c9d-49c6-b3af-bd000aea0922-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:48:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Acquiring lock "cinder-quobyte-25348e6d-2c9d-49c6-b3af-bd000aea0922" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:48:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Lock "cinder-quobyte-25348e6d-2c9d-49c6-b3af-bd000aea0922" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:48:07 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[63408ec6-da82-4f07-97c6-d7645fe612e4]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:48:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:07 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 Jul 19 17:48:07 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:08 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922" returned: 0 in 0.818s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:08 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922 Jul 19 17:48:08 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:08 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-25348e6d-2c9d-49c6-b3af-bd000aea0922" returned: 0 in 0.453s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Lock "cinder-quobyte-25348e6d-2c9d-49c6-b3af-bd000aea0922" released by "delete_volume" :: held 1.388s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:48:08 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Created reservations ['10b2ae5f-820f-4100-9f3a-ca0923e711b2', '1bd09f9f-cbde-470d-a1de-e4533d48f3bb', 'f0fc2615-a95e-423a-ab8b-9bfbd601fb05', 'd6d67100-da77-4025-9cd6-4d5f61e95013'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:48:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:48:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:48:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:48:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:48:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:48:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:08 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:48:08 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:09 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.360s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:09 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:48:09 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Deleted volume successfully. Jul 19 17:48:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c86ce381-e6e4-4a77-897f-58116394bb22 tempest-CinderUnicodeTest-1291835972 None] Lock "cinder-25348e6d-2c9d-49c6-b3af-bd000aea0922-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:48:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Acquiring lock "cinder-7d65dafd-522e-49de-8078-3591e015fb89-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:48:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Lock "cinder-7d65dafd-522e-49de-8078-3591e015fb89-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:48:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Acquiring lock "cinder-quobyte-7d65dafd-522e-49de-8078-3591e015fb89" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:48:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Lock "cinder-quobyte-7d65dafd-522e-49de-8078-3591e015fb89" acquired by "delete_volume" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:48:09 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca22802a-0fee-41c0-adcf-06e5597df3ab]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:48:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7d65dafd-522e-49de-8078-3591e015fb89 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:09 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7d65dafd-522e-49de-8078-3591e015fb89 Jul 19 17:48:09 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:10 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7d65dafd-522e-49de-8078-3591e015fb89" returned: 0 in 0.575s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7d65dafd-522e-49de-8078-3591e015fb89 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:10 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7d65dafd-522e-49de-8078-3591e015fb89 Jul 19 17:48:10 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:10 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7d65dafd-522e-49de-8078-3591e015fb89" returned: 0 in 0.405s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Lock "cinder-quobyte-7d65dafd-522e-49de-8078-3591e015fb89" released by "delete_volume" :: held 1.058s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:48:10 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Created reservations ['bb71425a-65e0-42e6-bafe-12b46b03e855', '7cca56c8-f27e-4ff0-b939-a7c125e869da', 'e56dab0b-5f63-4d77-b02b-e4fb5e0bc7a3', 'e68f96eb-e8b0-4575-b9b5-2f2a6d732661'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:48:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:48:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:48:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:48:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:48:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:48:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:11 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:48:11 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:11 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.339s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:11 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:48:11 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Deleted volume successfully. Jul 19 17:48:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ab2eea98-2505-4113-b281-28d74cff7374 tempest-CinderUnicodeTest-1291835972 None] Lock "cinder-7d65dafd-522e-49de-8078-3591e015fb89-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:48:20 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=25,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:48:21 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=21,cinder:UPDATE=31,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Flow 'volume_create_manager' (0b54ae2c-3e43-41ee-aeef-1ee9ef92d5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b87011-59c6-4656-b234-c4888f8246bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b87011-59c6-4656-b234-c4888f8246bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-259495506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bb51de-33b2-4a9d-92a1-47acb23ca0d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4800edc2cd5498d8b48770f78e364b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:48:30Z,use_quota=True,user_id='4d0f9dd645af47b9bc508cfa13201675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb11ee43-2f5f-4d43-914c-5197781b7939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb11ee43-2f5f-4d43-914c-5197781b7939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9120d6fd-1832-49c2-bd75-81630521ecf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9120d6fd-1832-49c2-bd75-81630521ecf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75bb51de-33b2-4a9d-92a1-47acb23ca0d5', 'volume_name': 'volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda7c0db-ba9f-4675-9eb0-f21d150a2333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda7c0db-ba9f-4675-9eb0-f21d150a2333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bccfd55-d56a-47b6-841d-a783ba86636d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:30 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Volume 75bb51de-33b2-4a9d-92a1-47acb23ca0d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5', 'volume_size': 1} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-259495506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bb51de-33b2-4a9d-92a1-47acb23ca0d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4800edc2cd5498d8b48770f78e364b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:48:30Z,use_quota=True,user_id='4d0f9dd645af47b9bc508cfa13201675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Creating volume 75bb51de-33b2-4a9d-92a1-47acb23ca0d5 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:48:30 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:30 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5 1073741824 Jul 19 17:48:30 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Flow 'volume_create_manager' (b4845b34-2d07-43cd-a914-aa0aa9a07518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3210f2-95f5-4c28-935c-19fe8812635a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3210f2-95f5-4c28-935c-19fe8812635a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-933122439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a7d3a0-5143-4830-a5f1-c652a535ead8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4800edc2cd5498d8b48770f78e364b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:48:31Z,use_quota=True,user_id='4d0f9dd645af47b9bc508cfa13201675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8699b6c9-8373-4675-9a62-e94bf77a7d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8699b6c9-8373-4675-9a62-e94bf77a7d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae4759b-0d84-4eb7-b5af-7011ed684c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae4759b-0d84-4eb7-b5af-7011ed684c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a7d3a0-5143-4830-a5f1-c652a535ead8', 'volume_name': 'volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ef7eee-455a-4f8f-80e4-386f020da900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ef7eee-455a-4f8f-80e4-386f020da900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3cd480-10f9-4310-9677-533c589f3b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:30 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Volume d2a7d3a0-5143-4830-a5f1-c652a535ead8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8', 'volume_size': 1} Jul 19 17:48:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:48:31 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5 1073741824" returned: 0 in 0.712s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:31 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5 Jul 19 17:48:31 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:31 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5" returned: 0 in 0.416s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.720s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-933122439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a7d3a0-5143-4830-a5f1-c652a535ead8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4800edc2cd5498d8b48770f78e364b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:48:31Z,use_quota=True,user_id='4d0f9dd645af47b9bc508cfa13201675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Creating volume d2a7d3a0-5143-4830-a5f1-c652a535ead8 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:48:31 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bccfd55-d56a-47b6-841d-a783ba86636d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d04ba35-930e-4e3e-bf36-e11193652f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:31 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Volume volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5 (75bb51de-33b2-4a9d-92a1-47acb23ca0d5): created successfully Jul 19 17:48:31 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8 1073741824 Jul 19 17:48:31 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d04ba35-930e-4e3e-bf36-e11193652f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Flow 'volume_create_manager' (0b54ae2c-3e43-41ee-aeef-1ee9ef92d5bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:48:31 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-2f9eca19-d899-42a5-a459-e8f19070935f tempest-TestServerVolumeAttachmentScenario-235475108 None] Created volume successfully. Jul 19 17:48:32 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8 1073741824" returned: 0 in 0.713s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:32 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8 Jul 19 17:48:32 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:32 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8" returned: 0 in 0.290s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:48:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:48:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3cd480-10f9-4310-9677-533c589f3b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68f1201-6735-40b7-beb4-366f6e74f5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:32 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Volume volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8 (d2a7d3a0-5143-4830-a5f1-c652a535ead8): created successfully Jul 19 17:48:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68f1201-6735-40b7-beb4-366f6e74f5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Flow 'volume_create_manager' (b4845b34-2d07-43cd-a914-aa0aa9a07518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:48:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ac57dcb5-879e-4f73-ae8c-ccf3f5831c00 tempest-TestServerVolumeAttachmentScenario-235475108 None] Created volume successfully. Jul 19 17:48:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-663b98c4-cfb2-45cb-87df-578fa288104f req-e9531034-fbd6-451a-9559-988182ccb4e9 tempest-TestStampPattern-2100490008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:48:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-663b98c4-cfb2-45cb-87df-578fa288104f req-e9531034-fbd6-451a-9559-988182ccb4e9 tempest-TestStampPattern-2100490008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:48:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-663b98c4-cfb2-45cb-87df-578fa288104f req-e9531034-fbd6-451a-9559-988182ccb4e9 tempest-TestStampPattern-2100490008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:48:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-663b98c4-cfb2-45cb-87df-578fa288104f req-e9531034-fbd6-451a-9559-988182ccb4e9 tempest-TestStampPattern-2100490008 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-3dfec182-6f50-41a1-adac-9c53b8add333', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '392e5352-846d-45d4-8202-15f912245c1d', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:48:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-663b98c4-cfb2-45cb-87df-578fa288104f req-e9531034-fbd6-451a-9559-988182ccb4e9 tempest-TestStampPattern-2100490008 None] attachment_update completed successfully. Jul 19 17:48:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:48:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:48:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:48:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:48:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:48:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:48:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:35 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:48:35 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:35 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.396s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:48:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:48:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 29 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:48:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:48:38 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-44deeccb-eb43-40b5-8288-4238eba157db req-098956cb-dbd6-4840-ba6e-263ca57548de tempest-TestStampPattern-2100490008 None] Terminate volume connection completed successfully. Jul 19 17:48:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-44deeccb-eb43-40b5-8288-4238eba157db req-098956cb-dbd6-4840-ba6e-263ca57548de tempest-TestStampPattern-2100490008 None] Deleting attachment 392e5352-846d-45d4-8202-15f912245c1d. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:48:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:48:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:48:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] Creating offline snapshot 54ac8f00-47c0-42b1-b06c-ea5552dafa48 of volume 3dfec182-6f50-41a1-adac-9c53b8add333 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:48:40 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[da29124a-c601-4a42-b84f-79b7846d68ab]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:48:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:40 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 Jul 19 17:48:40 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:40 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333" returned: 0 in 0.611s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:40 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 1G Jul 19 17:48:40 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:41 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 1G" returned: 0 in 0.661s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dfec182-6f50-41a1-adac-9c53b8add333 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:41 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dfec182-6f50-41a1-adac-9c53b8add333 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 Jul 19 17:48:41 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:41 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dfec182-6f50-41a1-adac-9c53b8add333 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48" returned: 0 in 0.464s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:41 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 is being set with open permissions: ugo+rw Jul 19 17:48:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:41 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 Jul 19 17:48:41 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:42 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48" returned: 0 in 0.382s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:42 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.info Jul 19 17:48:42 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:42 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.info" returned: 0 in 0.467s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:42 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.info is being set with open permissions: ugo+rw Jul 19 17:48:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:42 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.info Jul 19 17:48:42 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:43 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.info" returned: 0 in 0.473s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.287s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:48:43 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f278d8ed-2c78-44cd-af3b-b9cc5d2df3f5 tempest-TestStampPattern-2100490008 None] Create snapshot completed successfully Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=16,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Flow 'volume_create_manager' (abf90d58-d814-48fe-9880-8d299c82ab38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241d5ffb-f2ac-45e8-b3cc-4510f2fd5f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241d5ffb-f2ac-45e8-b3cc-4510f2fd5f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2002896878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7859a688-40f1-40ae-aa03-763563d763eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe6719c92ccd441bac2bc7fbb144a99d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:48:53Z,use_quota=True,user_id='daa54df6b3754adb96a4f8de85d65e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3234ced8-074d-4576-b422-3be4e2175e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3234ced8-074d-4576-b422-3be4e2175e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2a6239-1b5c-4db7-9d26-5855bcd34518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2a6239-1b5c-4db7-9d26-5855bcd34518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7859a688-40f1-40ae-aa03-763563d763eb', 'volume_name': 'volume-7859a688-40f1-40ae-aa03-763563d763eb', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f11983-56f3-47ee-9088-fba370c14cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f11983-56f3-47ee-9088-fba370c14cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47637a18-c4b6-4ab7-a242-0b8d8c45c4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:52 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Volume 7859a688-40f1-40ae-aa03-763563d763eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7859a688-40f1-40ae-aa03-763563d763eb', 'volume_size': 1} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2002896878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7859a688-40f1-40ae-aa03-763563d763eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe6719c92ccd441bac2bc7fbb144a99d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:48:53Z,use_quota=True,user_id='daa54df6b3754adb96a4f8de85d65e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Creating volume 7859a688-40f1-40ae-aa03-763563d763eb {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:48:52 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:48:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7859a688-40f1-40ae-aa03-763563d763eb 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:52 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7859a688-40f1-40ae-aa03-763563d763eb 1073741824 Jul 19 17:48:52 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:53 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7859a688-40f1-40ae-aa03-763563d763eb 1073741824" returned: 0 in 0.512s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7859a688-40f1-40ae-aa03-763563d763eb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:53 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7859a688-40f1-40ae-aa03-763563d763eb Jul 19 17:48:53 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:53 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7859a688-40f1-40ae-aa03-763563d763eb" returned: 0 in 0.390s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:48:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:48:53 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47637a18-c4b6-4ab7-a242-0b8d8c45c4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7859a688-40f1-40ae-aa03-763563d763eb', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:53 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3a3125-282b-466d-a696-5bac31983e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:53 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Volume volume-7859a688-40f1-40ae-aa03-763563d763eb (7859a688-40f1-40ae-aa03-763563d763eb): created successfully Jul 19 17:48:53 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3a3125-282b-466d-a696-5bac31983e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:53 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Flow 'volume_create_manager' (abf90d58-d814-48fe-9880-8d299c82ab38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:48:53 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-2f1b70b7-f57e-469f-ad4b-10bff35f1040 tempest-TestMinimumBasicScenario-790410862 None] Created volume successfully. Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Flow 'volume_create_manager' (a8ec68f1-4c34-4ca4-a2c0-513c1e20667d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346c7a7c-20c1-4597-9f03-f11fb7b0f886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346c7a7c-20c1-4597-9f03-f11fb7b0f886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1757391378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff47b94-aa92-458f-98b3-1463dc6808b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d6d7668fb54f399faf25bf6f17efee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=54ac8f00-47c0-42b1-b06c-ea5552dafa48,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:48:54Z,use_quota=True,user_id='be9a87939794404cb9db814bc63062fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b40029-fb82-4b31-9e78-44957028766c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b40029-fb82-4b31-9e78-44957028766c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2383ae91-c7df-4c30-bfa8-34900d64f483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2383ae91-c7df-4c30-bfa8-34900d64f483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fff47b94-aa92-458f-98b3-1463dc6808b0', 'volume_name': 'volume-fff47b94-aa92-458f-98b3-1463dc6808b0', 'volume_size': 1, 'snapshot_id': '54ac8f00-47c0-42b1-b06c-ea5552dafa48'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea40ed19-ae85-4a26-b739-16366da3b8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea40ed19-ae85-4a26-b739-16366da3b8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0711277e-f514-4861-b6ee-3d1f28f0831d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:48:54 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Volume fff47b94-aa92-458f-98b3-1463dc6808b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fff47b94-aa92-458f-98b3-1463dc6808b0', 'volume_size': 1, 'snapshot_id': '54ac8f00-47c0-42b1-b06c-ea5552dafa48'} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Acquiring lock "cinder-quobyte-54ac8f00-47c0-42b1-b06c-ea5552dafa48-fff47b94-aa92-458f-98b3-1463dc6808b0" by "_create_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Lock "cinder-quobyte-54ac8f00-47c0-42b1-b06c-ea5552dafa48-fff47b94-aa92-458f-98b3-1463dc6808b0" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Creating volume fff47b94-aa92-458f-98b3-1463dc6808b0 from snapshot 54ac8f00-47c0-42b1-b06c-ea5552dafa48 {{(pid=87676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Acquiring lock "cinder-quobyte-fff47b94-aa92-458f-98b3-1463dc6808b0" by "_copy_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Lock "cinder-quobyte-fff47b94-aa92-458f-98b3-1463dc6808b0" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] snapshot: 54ac8f00-47c0-42b1-b06c-ea5552dafa48, volume: fff47b94-aa92-458f-98b3-1463dc6808b0, {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3503fe-9355-40de-bd0e-c5a10ebfa8e3]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:54 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 Jul 19 17:48:54 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:54 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48" returned: 0 in 0.531s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dfec182-6f50-41a1-adac-9c53b8add333(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] will copy from snapshot at /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Creating direct copy from snapshot {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e5f117-dae5-46f1-a16d-160c3caf95c5]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:48:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:55 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 Jul 19 17:48:55 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:55 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Jul 19 17:48:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333" returned: 0 in 0.521s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:48:55 devstack cinder-volume[87676]: DEBUG cinder.utils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Path /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0 not found in is_blk_device check {{(pid=87676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 17:48:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:48:55 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0 Jul 19 17:48:55 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:48:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-9741438a-6959-4a1e-9c79-d54d7921742a req-8fc41c92-803c-491f-ba74-4145f07b880d tempest-TestMinimumBasicScenario-790410862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:03 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0" returned: 0 in 7.783s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:03 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd48904-e663-4e28-aff5-a9a906728458]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:49:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:03 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 Jul 19 17:49:03 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:04 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333" returned: 0 in 1.292s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:04 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Image conversion details: src /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333, size 1024.00 MB, duration 7.79 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:49:04 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Converted 1024.00 MB image at 131.50 MB/s Jul 19 17:49:04 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0 is being set with open permissions: ugo+rw Jul 19 17:49:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:04 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0 Jul 19 17:49:04 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:04 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0" returned: 0 in 0.404s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Lock "cinder-quobyte-fff47b94-aa92-458f-98b3-1463dc6808b0" released by "_copy_volume_from_snapshot" :: held 10.731s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Lock "cinder-quobyte-54ac8f00-47c0-42b1-b06c-ea5552dafa48-fff47b94-aa92-458f-98b3-1463dc6808b0" released by "_create_volume_from_snapshot" :: held 10.789s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.807s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-9741438a-6959-4a1e-9c79-d54d7921742a req-8fc41c92-803c-491f-ba74-4145f07b880d tempest-TestMinimumBasicScenario-790410862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.787s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-9741438a-6959-4a1e-9c79-d54d7921742a req-8fc41c92-803c-491f-ba74-4145f07b880d tempest-TestMinimumBasicScenario-790410862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.112s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0711277e-f514-4861-b6ee-3d1f28f0831d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff47b94-aa92-458f-98b3-1463dc6808b0', 'volume_size': 1, 'snapshot_id': '54ac8f00-47c0-42b1-b06c-ea5552dafa48'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6ecd0a-16e4-496d-b538-e34c77352db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:05 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Volume volume-fff47b94-aa92-458f-98b3-1463dc6808b0 (fff47b94-aa92-458f-98b3-1463dc6808b0): created successfully Jul 19 17:49:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6ecd0a-16e4-496d-b538-e34c77352db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Flow 'volume_create_manager' (a8ec68f1-4c34-4ca4-a2c0-513c1e20667d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:49:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-9741438a-6959-4a1e-9c79-d54d7921742a req-8fc41c92-803c-491f-ba74-4145f07b880d tempest-TestMinimumBasicScenario-790410862 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-7859a688-40f1-40ae-aa03-763563d763eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '177de3e3-91df-4099-b868-a56695ba1c40', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:49:05 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-81100ae1-d5da-4953-85df-1bf2af3afca7 tempest-TestStampPattern-2100490008 None] Created volume successfully. Jul 19 17:49:05 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-9741438a-6959-4a1e-9c79-d54d7921742a req-8fc41c92-803c-491f-ba74-4145f07b880d tempest-TestMinimumBasicScenario-790410862 None] attachment_update completed successfully. Jul 19 17:49:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-5eb1e699-7220-4844-95f5-11c7c3b7259b req-db9c6aca-cd86-4fc1-aaa3-25e99f2561a4 tempest-TestServerVolumeAttachmentScenario-235475108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-5eb1e699-7220-4844-95f5-11c7c3b7259b req-db9c6aca-cd86-4fc1-aaa3-25e99f2561a4 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-5eb1e699-7220-4844-95f5-11c7c3b7259b req-db9c6aca-cd86-4fc1-aaa3-25e99f2561a4 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-5eb1e699-7220-4844-95f5-11c7c3b7259b req-db9c6aca-cd86-4fc1-aaa3-25e99f2561a4 tempest-TestServerVolumeAttachmentScenario-235475108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '712445f3-eec7-4884-b496-a0704d849bdf', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:49:05 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-5eb1e699-7220-4844-95f5-11c7c3b7259b req-db9c6aca-cd86-4fc1-aaa3-25e99f2561a4 tempest-TestServerVolumeAttachmentScenario-235475108 None] attachment_update completed successfully. Jul 19 17:49:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-c8bd9e0b-bf15-41cf-933d-520bebad164b req-78dc898d-beb5-4d17-9f45-1089257b1fab tempest-TestServerVolumeAttachmentScenario-235475108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-c8bd9e0b-bf15-41cf-933d-520bebad164b req-78dc898d-beb5-4d17-9f45-1089257b1fab tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-c8bd9e0b-bf15-41cf-933d-520bebad164b req-78dc898d-beb5-4d17-9f45-1089257b1fab tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:11 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-c8bd9e0b-bf15-41cf-933d-520bebad164b req-78dc898d-beb5-4d17-9f45-1089257b1fab tempest-TestServerVolumeAttachmentScenario-235475108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '385a58e4-cffc-43a9-be60-7ca8d974420f', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:49:11 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-c8bd9e0b-bf15-41cf-933d-520bebad164b req-78dc898d-beb5-4d17-9f45-1089257b1fab tempest-TestServerVolumeAttachmentScenario-235475108 None] attachment_update completed successfully. Jul 19 17:49:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-567600ba-2a0e-4f4a-b493-cdeb0ed5b6cc req-4534312e-6c11-409a-a5c3-01d5d0938900 tempest-TestServerVolumeAttachmentScenario-235475108 None] Terminate volume connection completed successfully. Jul 19 17:49:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-567600ba-2a0e-4f4a-b493-cdeb0ed5b6cc req-4534312e-6c11-409a-a5c3-01d5d0938900 tempest-TestServerVolumeAttachmentScenario-235475108 None] Deleting attachment 385a58e4-cffc-43a9-be60-7ca8d974420f. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:49:16 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-f62bf2fc-8f55-48a5-b6d0-1b6d6b0c2a3b req-f1e42133-82a5-49a1-9ec1-dc426c1af816 tempest-TestServerVolumeAttachmentScenario-235475108 None] Terminate volume connection completed successfully. Jul 19 17:49:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-f62bf2fc-8f55-48a5-b6d0-1b6d6b0c2a3b req-f1e42133-82a5-49a1-9ec1-dc426c1af816 tempest-TestServerVolumeAttachmentScenario-235475108 None] Deleting attachment 712445f3-eec7-4884-b496-a0704d849bdf. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:49:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Acquiring lock "cinder-d2a7d3a0-5143-4830-a5f1-c652a535ead8-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "cinder-d2a7d3a0-5143-4830-a5f1-c652a535ead8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:22 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=44,cinder:UPDATE=19,cinder:DELETE=3,cinder:INSERT=1 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:49:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Acquiring lock "cinder-quobyte-d2a7d3a0-5143-4830-a5f1-c652a535ead8" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "cinder-quobyte-d2a7d3a0-5143-4830-a5f1-c652a535ead8" acquired by "delete_volume" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:22 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f829a41b-3495-4e1f-94ae-2d6b487cecb6]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:49:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:22 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8 Jul 19 17:49:22 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:22 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8" returned: 0 in 0.372s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:22 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8 Jul 19 17:49:22 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:23 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a7d3a0-5143-4830-a5f1-c652a535ead8" returned: 0 in 0.267s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "cinder-quobyte-d2a7d3a0-5143-4830-a5f1-c652a535ead8" released by "delete_volume" :: held 0.690s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Created reservations ['e6b29cd4-19d7-4de0-8f44-aaf097d257d4', 'b803c190-ee03-4562-af80-5db044d5ccab', '8a9c0acb-79c3-4ea1-bc35-46d93c558789', '9883074f-96ce-4901-ba6e-9b8735ab98a8'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:23 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:49:23 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Acquiring lock "cinder-75bb51de-33b2-4a9d-92a1-47acb23ca0d5-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "cinder-75bb51de-33b2-4a9d-92a1-47acb23ca0d5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:23 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.324s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:49:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Deleted volume successfully. Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Acquiring lock "cinder-quobyte-75bb51de-33b2-4a9d-92a1-47acb23ca0d5" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "cinder-quobyte-75bb51de-33b2-4a9d-92a1-47acb23ca0d5" acquired by "delete_volume" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6daba452-232d-45a6-9010-e79b27d46dd8 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "cinder-d2a7d3a0-5143-4830-a5f1-c652a535ead8-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db8ef85-923e-4722-8d9d-c32fd40a3799]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:49:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:23 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5 Jul 19 17:49:23 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:24 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5" returned: 0 in 0.375s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:24 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5 Jul 19 17:49:24 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:24 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-75bb51de-33b2-4a9d-92a1-47acb23ca0d5" returned: 0 in 0.257s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "cinder-quobyte-75bb51de-33b2-4a9d-92a1-47acb23ca0d5" released by "delete_volume" :: held 0.675s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:24 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Created reservations ['b04e17b7-0866-42a0-9c0c-62c45ec43d18', '120f3dc7-685f-49fe-997c-1fd71e530386', '78a8879e-5b87-4d2e-92c0-a23c64c2149a', '88a53430-13f1-4ddf-bbcf-2659e8aa4a2f'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:49:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:49:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:49:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:24 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:49:24 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:24 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.248s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:24 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:49:24 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Deleted volume successfully. Jul 19 17:49:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6318adf6-fd1a-49bc-995a-657d06db6ce1 tempest-TestServerVolumeAttachmentScenario-235475108 None] Lock "cinder-75bb51de-33b2-4a9d-92a1-47acb23ca0d5-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:34 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=14 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:49:34 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=31,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:49:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:49:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:49:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:49:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:35 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:49:35 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:35 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.254s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:49:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:49:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 29 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:49:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Flow 'volume_create_manager' (8190e9e4-6c5c-4cc5-8bcf-f719b4f843da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f29c6a8-0511-426f-927b-d64cb87ad9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f29c6a8-0511-426f-927b-d64cb87ad9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582147268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd2f846-3cb9-41da-97bd-71632a7e05cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c148bdf72d4f678ceb86f6bb22c938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:49:36Z,use_quota=True,user_id='3317f36d87ee4b308cef8ee561c87c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6fb94ec-c58e-4de9-83be-1a765c0677e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6fb94ec-c58e-4de9-83be-1a765c0677e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fdcf1e-697e-4dc1-b3be-ffe73fd97b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fdcf1e-697e-4dc1-b3be-ffe73fd97b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd2f846-3cb9-41da-97bd-71632a7e05cf', 'volume_name': 'volume-2cd2f846-3cb9-41da-97bd-71632a7e05cf', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e88db4b-59b7-4a04-b45c-7d459d0ff289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e88db4b-59b7-4a04-b45c-7d459d0ff289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0c5f2e-83c7-4037-957b-8ed9647e4af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:36 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Volume 2cd2f846-3cb9-41da-97bd-71632a7e05cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd2f846-3cb9-41da-97bd-71632a7e05cf', 'volume_size': 1} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582147268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd2f846-3cb9-41da-97bd-71632a7e05cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c148bdf72d4f678ceb86f6bb22c938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:49:36Z,use_quota=True,user_id='3317f36d87ee4b308cef8ee561c87c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Creating volume 2cd2f846-3cb9-41da-97bd-71632a7e05cf {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:49:36 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2cd2f846-3cb9-41da-97bd-71632a7e05cf 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:36 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2cd2f846-3cb9-41da-97bd-71632a7e05cf 1073741824 Jul 19 17:49:36 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-cff8192f-5993-4b42-af23-0414358c0e8b req-4050e1fb-07ce-4b9b-857a-4543b7eba959 tempest-TestStampPattern-2100490008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:36 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2cd2f846-3cb9-41da-97bd-71632a7e05cf 1073741824" returned: 0 in 0.410s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2cd2f846-3cb9-41da-97bd-71632a7e05cf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:36 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2cd2f846-3cb9-41da-97bd-71632a7e05cf Jul 19 17:49:36 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:36 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2cd2f846-3cb9-41da-97bd-71632a7e05cf" returned: 0 in 0.243s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-cff8192f-5993-4b42-af23-0414358c0e8b req-4050e1fb-07ce-4b9b-857a-4543b7eba959 tempest-TestStampPattern-2100490008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.496s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0c5f2e-83c7-4037-957b-8ed9647e4af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd2f846-3cb9-41da-97bd-71632a7e05cf', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300d5331-7322-4725-8426-7639cca4ea03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:36 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Volume volume-2cd2f846-3cb9-41da-97bd-71632a7e05cf (2cd2f846-3cb9-41da-97bd-71632a7e05cf): created successfully Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300d5331-7322-4725-8426-7639cca4ea03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Flow 'volume_create_manager' (8190e9e4-6c5c-4cc5-8bcf-f719b4f843da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65771e7-e166-47dd-aaeb-2e1d437e510f]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:49:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-cff8192f-5993-4b42-af23-0414358c0e8b req-4050e1fb-07ce-4b9b-857a-4543b7eba959 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:36 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-952281a4-75cf-41f0-9151-29d5037e0969 tempest-ProjectReaderTests-1609047947 None] Created volume successfully. Jul 19 17:49:37 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0 Jul 19 17:49:37 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Acquiring lock "cinder-2cd2f846-3cb9-41da-97bd-71632a7e05cf-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Lock "cinder-2cd2f846-3cb9-41da-97bd-71632a7e05cf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Acquiring lock "cinder-quobyte-2cd2f846-3cb9-41da-97bd-71632a7e05cf" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Lock "cinder-quobyte-2cd2f846-3cb9-41da-97bd-71632a7e05cf" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:37 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [req-cff8192f-5993-4b42-af23-0414358c0e8b req-4050e1fb-07ce-4b9b-857a-4543b7eba959 tempest-TestStampPattern-2100490008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0" returned: 0 in 0.428s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [req-cff8192f-5993-4b42-af23-0414358c0e8b req-4050e1fb-07ce-4b9b-857a-4543b7eba959 tempest-TestStampPattern-2100490008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.480s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:37 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1748a928-c78b-4f4f-90cd-d94fde6082df]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:49:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2cd2f846-3cb9-41da-97bd-71632a7e05cf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-cff8192f-5993-4b42-af23-0414358c0e8b req-4050e1fb-07ce-4b9b-857a-4543b7eba959 tempest-TestStampPattern-2100490008 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c', 'name': 'volume-fff47b94-aa92-458f-98b3-1463dc6808b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2a85e1a-e8d7-4117-9594-54dedf35d828', 'enforce_multipath': True} {{(pid=87676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 19 17:49:37 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-cff8192f-5993-4b42-af23-0414358c0e8b req-4050e1fb-07ce-4b9b-857a-4543b7eba959 tempest-TestStampPattern-2100490008 None] attachment_update completed successfully. Jul 19 17:49:37 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2cd2f846-3cb9-41da-97bd-71632a7e05cf Jul 19 17:49:37 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:37 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2cd2f846-3cb9-41da-97bd-71632a7e05cf" returned: 0 in 0.398s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2cd2f846-3cb9-41da-97bd-71632a7e05cf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:37 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2cd2f846-3cb9-41da-97bd-71632a7e05cf Jul 19 17:49:37 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:38 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2cd2f846-3cb9-41da-97bd-71632a7e05cf" returned: 0 in 0.271s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Lock "cinder-quobyte-2cd2f846-3cb9-41da-97bd-71632a7e05cf" released by "delete_volume" :: held 0.714s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Created reservations ['0b6a8185-93e5-401f-a05a-6a44788eb9a4', '14210b40-d27c-42b0-a13a-a577a0ad8d33', 'f9ca6850-ac28-46b6-8ec3-4bab04738664', 'e9de1965-5fbb-43ac-ac8f-e0269f9ad42f'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:38 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:49:38 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:38 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.252s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:49:38 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Deleted volume successfully. Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9d306aea-aedc-41a9-90fa-d35b04e809fd tempest-ProjectReaderTests-1609047947 None] Lock "cinder-2cd2f846-3cb9-41da-97bd-71632a7e05cf-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Flow 'volume_create_manager' (a0703c01-2ec6-4f16-a806-415a264e812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8daa5630-841e-42c8-ac98-87d040b4cbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8daa5630-841e-42c8-ac98-87d040b4cbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1369622108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30267f8a-1501-454e-9a5c-d1ce81aaa285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c148bdf72d4f678ceb86f6bb22c938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:49:39Z,use_quota=True,user_id='3317f36d87ee4b308cef8ee561c87c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84e1832-fe4e-4576-972a-ecf56ea0297d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84e1832-fe4e-4576-972a-ecf56ea0297d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af09c137-9328-4db4-bbd4-5d4559b2d214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af09c137-9328-4db4-bbd4-5d4559b2d214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30267f8a-1501-454e-9a5c-d1ce81aaa285', 'volume_name': 'volume-30267f8a-1501-454e-9a5c-d1ce81aaa285', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff0c7c8-8963-48da-af5b-26cd1fe56549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff0c7c8-8963-48da-af5b-26cd1fe56549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3542d3b-6f7e-4576-b2ed-982aff93c3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:38 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Volume 30267f8a-1501-454e-9a5c-d1ce81aaa285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30267f8a-1501-454e-9a5c-d1ce81aaa285', 'volume_size': 1} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1369622108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30267f8a-1501-454e-9a5c-d1ce81aaa285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c148bdf72d4f678ceb86f6bb22c938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:49:39Z,use_quota=True,user_id='3317f36d87ee4b308cef8ee561c87c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Creating volume 30267f8a-1501-454e-9a5c-d1ce81aaa285 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:49:38 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:49:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-30267f8a-1501-454e-9a5c-d1ce81aaa285 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:39 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-30267f8a-1501-454e-9a5c-d1ce81aaa285 1073741824 Jul 19 17:49:39 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:39 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-30267f8a-1501-454e-9a5c-d1ce81aaa285 1073741824" returned: 0 in 0.488s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-30267f8a-1501-454e-9a5c-d1ce81aaa285 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:39 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-30267f8a-1501-454e-9a5c-d1ce81aaa285 Jul 19 17:49:39 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:39 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-30267f8a-1501-454e-9a5c-d1ce81aaa285" returned: 0 in 0.267s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:49:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3542d3b-6f7e-4576-b2ed-982aff93c3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30267f8a-1501-454e-9a5c-d1ce81aaa285', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22964326-67ce-4c7b-8b78-42d0c012da56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:39 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Volume volume-30267f8a-1501-454e-9a5c-d1ce81aaa285 (30267f8a-1501-454e-9a5c-d1ce81aaa285): created successfully Jul 19 17:49:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22964326-67ce-4c7b-8b78-42d0c012da56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Flow 'volume_create_manager' (a0703c01-2ec6-4f16-a806-415a264e812d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:49:39 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-2f3b46cd-5663-4fd8-b7fa-8a2f75f77c2f req-effcd181-b2de-45a7-b9fc-715d70773595 tempest-TestStampPattern-2100490008 None] Terminate volume connection completed successfully. Jul 19 17:49:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-2f3b46cd-5663-4fd8-b7fa-8a2f75f77c2f req-effcd181-b2de-45a7-b9fc-715d70773595 tempest-TestStampPattern-2100490008 None] Deleting attachment e2a85e1a-e8d7-4117-9594-54dedf35d828. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:49:39 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-da96c61a-3d7a-4919-bc31-5d7856a99c29 tempest-ProjectReaderTests-1609047947 None] Created volume successfully. Jul 19 17:49:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Acquiring lock "cinder-30267f8a-1501-454e-9a5c-d1ce81aaa285-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Lock "cinder-30267f8a-1501-454e-9a5c-d1ce81aaa285-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Acquiring lock "cinder-quobyte-30267f8a-1501-454e-9a5c-d1ce81aaa285" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Lock "cinder-quobyte-30267f8a-1501-454e-9a5c-d1ce81aaa285" acquired by "delete_volume" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:41 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c482621-f205-4dda-8485-79c6a33f0a67]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:49:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-30267f8a-1501-454e-9a5c-d1ce81aaa285 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:41 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-30267f8a-1501-454e-9a5c-d1ce81aaa285 Jul 19 17:49:41 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:41 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-30267f8a-1501-454e-9a5c-d1ce81aaa285" returned: 0 in 0.528s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-30267f8a-1501-454e-9a5c-d1ce81aaa285 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:41 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-30267f8a-1501-454e-9a5c-d1ce81aaa285 Jul 19 17:49:41 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:42 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-30267f8a-1501-454e-9a5c-d1ce81aaa285" returned: 0 in 0.591s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Lock "cinder-quobyte-30267f8a-1501-454e-9a5c-d1ce81aaa285" released by "delete_volume" :: held 1.190s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:42 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Created reservations ['a8bc752f-0370-4b6c-a5f5-5ece13ad4e0e', '89a6cbec-e9d9-4708-8ef6-2ac2cb4f274a', 'bec017b7-92d2-4654-9e79-b8d8bc35e99d', '11fd291b-e1ae-4de5-99a7-22d272da3ebb'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:49:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:49:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:49:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:42 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:49:42 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:42 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.297s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:42 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:49:42 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Deleted volume successfully. Jul 19 17:49:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-352d0092-39d3-4f91-93b9-a5aabaf8f093 tempest-ProjectReaderTests-1609047947 None] Lock "cinder-30267f8a-1501-454e-9a5c-d1ce81aaa285-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:43 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:49:43 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Flow 'volume_create_manager' (0f790e77-871d-4f20-91be-92edd7317154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:49:43 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7185eafc-57cf-4b00-b51f-e0c5bd99ec17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7185eafc-57cf-4b00-b51f-e0c5bd99ec17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645380871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36ac21a-76ba-4852-ae4c-3c7472780e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c148bdf72d4f678ceb86f6bb22c938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:49:44Z,use_quota=True,user_id='3317f36d87ee4b308cef8ee561c87c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7650b293-1d8b-434a-b6d6-59a22b3e4cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7650b293-1d8b-434a-b6d6-59a22b3e4cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a4cddf-7455-4002-b5e7-2cdffbc649ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a4cddf-7455-4002-b5e7-2cdffbc649ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36ac21a-76ba-4852-ae4c-3c7472780e20', 'volume_name': 'volume-e36ac21a-76ba-4852-ae4c-3c7472780e20', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562c0c24-8536-4abf-9cf3-93233819839d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562c0c24-8536-4abf-9cf3-93233819839d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64f4643-9e36-4d23-b2cd-5fda79ff1e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:44 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Volume e36ac21a-76ba-4852-ae4c-3c7472780e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36ac21a-76ba-4852-ae4c-3c7472780e20', 'volume_size': 1} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645380871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36ac21a-76ba-4852-ae4c-3c7472780e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c148bdf72d4f678ceb86f6bb22c938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:49:44Z,use_quota=True,user_id='3317f36d87ee4b308cef8ee561c87c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Creating volume e36ac21a-76ba-4852-ae4c-3c7472780e20 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:49:44 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e36ac21a-76ba-4852-ae4c-3c7472780e20 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:44 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e36ac21a-76ba-4852-ae4c-3c7472780e20 1073741824 Jul 19 17:49:44 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Acquiring lock "cinder-fff47b94-aa92-458f-98b3-1463dc6808b0-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Lock "cinder-fff47b94-aa92-458f-98b3-1463dc6808b0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Acquiring lock "cinder-quobyte-fff47b94-aa92-458f-98b3-1463dc6808b0" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Lock "cinder-quobyte-fff47b94-aa92-458f-98b3-1463dc6808b0" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[362266b1-dddf-4a7d-982b-b489c4a814d8]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:44 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e36ac21a-76ba-4852-ae4c-3c7472780e20 1073741824" returned: 0 in 0.543s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e36ac21a-76ba-4852-ae4c-3c7472780e20 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:44 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0 Jul 19 17:49:44 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:44 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e36ac21a-76ba-4852-ae4c-3c7472780e20 Jul 19 17:49:44 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:44 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e36ac21a-76ba-4852-ae4c-3c7472780e20" returned: 0 in 0.281s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:44 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64f4643-9e36-4d23-b2cd-5fda79ff1e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36ac21a-76ba-4852-ae4c-3c7472780e20', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68e07da-7cac-43d1-8295-fa675fe6ac38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0" returned: 0 in 0.417s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:44 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Volume volume-e36ac21a-76ba-4852-ae4c-3c7472780e20 (e36ac21a-76ba-4852-ae4c-3c7472780e20): created successfully Jul 19 17:49:44 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0 Jul 19 17:49:44 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68e07da-7cac-43d1-8295-fa675fe6ac38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Flow 'volume_create_manager' (0f790e77-871d-4f20-91be-92edd7317154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:49:45 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-2db445f2-5a9e-40b0-b7ee-cd3860b47e87 tempest-ProjectReaderTests-1609047947 None] Created volume successfully. Jul 19 17:49:45 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fff47b94-aa92-458f-98b3-1463dc6808b0" returned: 0 in 0.263s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Lock "cinder-quobyte-fff47b94-aa92-458f-98b3-1463dc6808b0" released by "delete_volume" :: held 0.734s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:45 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Created reservations ['3c174044-b0d1-44eb-a525-0389f7f12026', 'cc6f3dfa-9ec6-4ca8-85dc-d0baaff0d595', '2941f55a-c954-4355-9259-c6153da39ce9', '88b8e45e-f584-4697-9f50-83a096739435'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:49:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:49:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:49:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:45 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:49:45 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:45 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.335s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:45 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:49:45 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Deleted volume successfully. Jul 19 17:49:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ea515cbd-9d79-4243-b635-374e81fa7f33 tempest-TestStampPattern-2100490008 None] Lock "cinder-fff47b94-aa92-458f-98b3-1463dc6808b0-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Acquiring lock "cinder-54ac8f00-47c0-42b1-b06c-ea5552dafa48-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Lock "cinder-54ac8f00-47c0-42b1-b06c-ea5552dafa48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Acquiring lock "cinder-quobyte-3dfec182-6f50-41a1-adac-9c53b8add333" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Lock "cinder-quobyte-3dfec182-6f50-41a1-adac-9c53b8add333" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Acquiring lock "cinder-quobyte-54ac8f00-47c0-42b1-b06c-ea5552dafa48" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Lock "cinder-quobyte-54ac8f00-47c0-42b1-b06c-ea5552dafa48" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Deleting offline snapshot 54ac8f00-47c0-42b1-b06c-ea5552dafa48 of volume 3dfec182-6f50-41a1-adac-9c53b8add333 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] snapshot_file for this snap is: volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9512dbd-2cd0-46be-99dd-664dc6df47fa]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:46 devstack cinder-volume[87676]: INFO cinder.volume.manager [req-19b9ef94-095e-42dc-8d89-9455718db14c req-9ca58b0c-d40f-4c1e-9058-93938be74fbd tempest-TestMinimumBasicScenario-790410862 None] Terminate volume connection completed successfully. Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [req-19b9ef94-095e-42dc-8d89-9455718db14c req-9ca58b0c-d40f-4c1e-9058-93938be74fbd tempest-TestMinimumBasicScenario-790410862 None] Deleting attachment 177de3e3-91df-4099-b868-a56695ba1c40. {{(pid=87676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Acquiring lock "cinder-e36ac21a-76ba-4852-ae4c-3c7472780e20-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Lock "cinder-e36ac21a-76ba-4852-ae4c-3c7472780e20-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:46 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 Jul 19 17:49:46 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Acquiring lock "cinder-quobyte-e36ac21a-76ba-4852-ae4c-3c7472780e20" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Lock "cinder-quobyte-e36ac21a-76ba-4852-ae4c-3c7472780e20" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[43542cd4-3915-47b3-a6b7-99ece99ec44d]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e36ac21a-76ba-4852-ae4c-3c7472780e20 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:46 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e36ac21a-76ba-4852-ae4c-3c7472780e20 Jul 19 17:49:46 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:46 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48" returned: 0 in 0.458s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dfec182-6f50-41a1-adac-9c53b8add333(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a04da1-47d0-40e9-9d29-bc122f576b90]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:46 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 Jul 19 17:49:46 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:46 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e36ac21a-76ba-4852-ae4c-3c7472780e20" returned: 0 in 0.417s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e36ac21a-76ba-4852-ae4c-3c7472780e20 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:46 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e36ac21a-76ba-4852-ae4c-3c7472780e20 Jul 19 17:49:46 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Acquiring lock "cinder-7859a688-40f1-40ae-aa03-763563d763eb-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Lock "cinder-7859a688-40f1-40ae-aa03-763563d763eb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Acquiring lock "cinder-quobyte-7859a688-40f1-40ae-aa03-763563d763eb" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Lock "cinder-quobyte-7859a688-40f1-40ae-aa03-763563d763eb" acquired by "delete_volume" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:47 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333" returned: 0 in 0.459s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dea63e-bfc6-4657-8a5a-7bdec921bdad]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7859a688-40f1-40ae-aa03-763563d763eb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:47 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 Jul 19 17:49:47 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:47 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e36ac21a-76ba-4852-ae4c-3c7472780e20" returned: 0 in 0.306s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Lock "cinder-quobyte-e36ac21a-76ba-4852-ae4c-3c7472780e20" released by "delete_volume" :: held 0.771s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Created reservations ['339d800c-d1a3-4b8b-a264-e1887d3b84d6', '2a02d63e-2323-483d-8a73-9a41f5e8f8dd', 'c72e33d7-05a9-4bd3-bfba-e80f9f1f7a22', '3e2cf5ac-df15-40d9-92a5-50c8625232fb'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:49:47 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7859a688-40f1-40ae-aa03-763563d763eb Jul 19 17:49:47 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:47 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:49:47 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:47 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48" returned: 0 in 0.384s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:47 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48 Jul 19 17:49:47 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:47 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7859a688-40f1-40ae-aa03-763563d763eb" returned: 0 in 0.409s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7859a688-40f1-40ae-aa03-763563d763eb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:47 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7859a688-40f1-40ae-aa03-763563d763eb Jul 19 17:49:47 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:47 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.284s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:49:47 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Deleted volume successfully. Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-abb5b06f-70ef-40c3-8394-175484ab78dc tempest-ProjectReaderTests-1609047947 None] Lock "cinder-e36ac21a-76ba-4852-ae4c-3c7472780e20-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:47 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333.54ac8f00-47c0-42b1-b06c-ea5552dafa48" returned: 0 in 0.279s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:47 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7859a688-40f1-40ae-aa03-763563d763eb" returned: 0 in 0.281s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Lock "cinder-quobyte-54ac8f00-47c0-42b1-b06c-ea5552dafa48" released by "_delete_snapshot" :: held 1.734s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Lock "cinder-quobyte-7859a688-40f1-40ae-aa03-763563d763eb" released by "delete_volume" :: held 0.744s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Lock "cinder-quobyte-3dfec182-6f50-41a1-adac-9c53b8add333" released by "delete_snapshot" :: held 1.769s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Created reservations ['6be19da7-7573-450d-887c-b91e8ecdaf09', 'bfdcb7b8-58b5-4806-98fd-abc60a312713', '465387db-219c-48d0-a992-e912c0ba8d53', 'e27e114d-69ea-4c03-b5b9-5b6f40a5d13c'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Created reservations ['9cb7d91b-4c82-4cf1-8f35-de24b58ff11c', '6d6644fb-4689-40db-b13b-6229601cdf5b', 'be9db59d-a85a-4ed2-9846-55bab89d68db', '038ae642-0a3b-4abb-af4d-48c0af65ad34'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:47 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Delete snapshot completed successfully. Jul 19 17:49:47 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:49:47 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a14d10e2-5e3e-46e0-976a-bfc93dee357a tempest-TestStampPattern-2100490008 None] Lock "cinder-54ac8f00-47c0-42b1-b06c-ea5552dafa48-delete_snapshot" released by "delete_snapshot" :: held 1.995s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Flow 'volume_create_manager' (50617806-37d8-49ad-9e42-21828134cae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc83632-2441-455d-ab97-2f38207ee32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc83632-2441-455d-ab97-2f38207ee32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1008843958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b5e58d-8f3b-484e-9fd8-ef44e65f90a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c148bdf72d4f678ceb86f6bb22c938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:49:48Z,use_quota=True,user_id='3317f36d87ee4b308cef8ee561c87c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc03335-ee85-4f8b-86c5-d71d9e10cdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc03335-ee85-4f8b-86c5-d71d9e10cdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d61ce68-8b85-434d-a5fc-ea296db3f239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d61ce68-8b85-434d-a5fc-ea296db3f239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b5e58d-8f3b-484e-9fd8-ef44e65f90a8', 'volume_name': 'volume-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069c1119-0ffd-4600-935b-0557e8367dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069c1119-0ffd-4600-935b-0557e8367dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6f20aa-0eb1-49cf-bf0c-2b9bee7a0f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:48 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Volume 17b5e58d-8f3b-484e-9fd8-ef44e65f90a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8', 'volume_size': 1} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1008843958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b5e58d-8f3b-484e-9fd8-ef44e65f90a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c148bdf72d4f678ceb86f6bb22c938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:49:48Z,use_quota=True,user_id='3317f36d87ee4b308cef8ee561c87c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Creating volume 17b5e58d-8f3b-484e-9fd8-ef44e65f90a8 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:49:48 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:48 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8 1073741824 Jul 19 17:49:48 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:48 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.329s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:49:48 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Deleted volume successfully. Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ce3c896f-70c0-48c7-b15a-e44ca5acdbca tempest-TestMinimumBasicScenario-790410862 None] Lock "cinder-7859a688-40f1-40ae-aa03-763563d763eb-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:48 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8 1073741824" returned: 0 in 0.756s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:48 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8 Jul 19 17:49:48 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:49 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8" returned: 0 in 0.435s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:49:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6f20aa-0eb1-49cf-bf0c-2b9bee7a0f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d35285-68e2-4886-bb1f-88e07ed8a2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:49:49 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Volume volume-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8 (17b5e58d-8f3b-484e-9fd8-ef44e65f90a8): created successfully Jul 19 17:49:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d35285-68e2-4886-bb1f-88e07ed8a2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:49:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Flow 'volume_create_manager' (50617806-37d8-49ad-9e42-21828134cae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:49:49 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c09537e1-5707-412c-9d4f-a2ccbdc83511 tempest-ProjectReaderTests-1609047947 None] Created volume successfully. Jul 19 17:49:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Acquiring lock "cinder-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Lock "cinder-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Acquiring lock "cinder-quobyte-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Lock "cinder-quobyte-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8" acquired by "delete_volume" :: waited 0.033s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:50 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d17752-ef80-4483-8388-94629178f711]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:49:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:50 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8 Jul 19 17:49:50 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:50 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8" returned: 0 in 0.519s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:50 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8 Jul 19 17:49:50 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:51 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8" returned: 0 in 0.360s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:51 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Lock "cinder-quobyte-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8" released by "delete_volume" :: held 0.945s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:51 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Created reservations ['f9ced220-c0bc-4b1a-9fba-0473746fa65c', '45e44061-755f-4dd6-9748-8d919341196e', '7098b61e-c83a-4bf5-9457-34951b3b338f', '4113a2dd-d0a7-4314-9e87-99c2f82f379e'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:49:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:49:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:49:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:51 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:49:51 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:51 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.340s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:51 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:49:51 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Deleted volume successfully. Jul 19 17:49:51 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e00cb4ef-2453-4fcd-8852-831a31d6b47d tempest-ProjectReaderTests-1609047947 None] Lock "cinder-17b5e58d-8f3b-484e-9fd8-ef44e65f90a8-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Acquiring lock "cinder-3dfec182-6f50-41a1-adac-9c53b8add333-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Lock "cinder-3dfec182-6f50-41a1-adac-9c53b8add333-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Acquiring lock "cinder-quobyte-3dfec182-6f50-41a1-adac-9c53b8add333" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:49:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Lock "cinder-quobyte-3dfec182-6f50-41a1-adac-9c53b8add333" acquired by "delete_volume" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:49:52 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[864c2422-5bb7-438f-9d97-638a7c3b9105]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:49:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:52 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 Jul 19 17:49:52 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:53 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333" returned: 0 in 0.417s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:53 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333 Jul 19 17:49:53 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:53 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3dfec182-6f50-41a1-adac-9c53b8add333" returned: 0 in 0.298s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Lock "cinder-quobyte-3dfec182-6f50-41a1-adac-9c53b8add333" released by "delete_volume" :: held 0.791s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:49:53 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Created reservations ['e56feaec-b434-44f4-adb5-865eaf964beb', '84a1af78-b780-424d-8306-90c0d9cd6889', 'b1350629-08d3-4fa2-b826-424442fde123', '208d97c3-3c96-416b-9c31-1b51362a4261'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:49:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:49:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:49:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:49:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:49:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:49:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:49:53 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:49:53 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:49:54 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Jul 19 17:49:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.322s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:49:54 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:49:54 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Deleted volume successfully. Jul 19 17:49:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-58cdad1e-d423-40d2-ad9e-ce7cdb5e8888 tempest-TestStampPattern-2100490008 None] Lock "cinder-3dfec182-6f50-41a1-adac-9c53b8add333-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:03 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=60,cinder:UPDATE=83,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:50:04 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:UPDATE=67,cinder:SELECT=54,cinder:DELETE=6,cinder:INSERT=19 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Flow 'volume_create_manager' (cbba333a-f8e2-478b-90c9-1b213061ad8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56052f44-e417-455b-8874-85f4aba921b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56052f44-e417-455b-8874-85f4aba921b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-606391875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8900234-6a3d-43f6-8e37-fc94aeffd4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950c61ecfee42afb6462031d6e2a897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:14Z,use_quota=True,user_id='62907f48f55b4266bc151744bd96c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a574c2-5b28-45ff-b264-611dd2fcb16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a574c2-5b28-45ff-b264-611dd2fcb16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea4b615-4f2a-4fe9-b021-821d72320e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea4b615-4f2a-4fe9-b021-821d72320e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8900234-6a3d-43f6-8e37-fc94aeffd4df', 'volume_name': 'volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6a1b4e-1c39-4872-af5e-8ab769fef296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6a1b4e-1c39-4872-af5e-8ab769fef296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8207b5d6-43b3-4bc8-8f86-97dad617cac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:14 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume c8900234-6a3d-43f6-8e37-fc94aeffd4df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df', 'volume_size': 1} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-606391875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8900234-6a3d-43f6-8e37-fc94aeffd4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950c61ecfee42afb6462031d6e2a897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:14Z,use_quota=True,user_id='62907f48f55b4266bc151744bd96c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Creating volume c8900234-6a3d-43f6-8e37-fc94aeffd4df {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:14 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:14 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df 1073741824 Jul 19 17:50:14 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:15 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df 1073741824" returned: 0 in 0.739s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:15 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df Jul 19 17:50:15 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:15 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df" returned: 0 in 0.397s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8207b5d6-43b3-4bc8-8f86-97dad617cac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20bdf745-c937-4cd7-b3bf-b75dd3aa7bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:15 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df (c8900234-6a3d-43f6-8e37-fc94aeffd4df): created successfully Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20bdf745-c937-4cd7-b3bf-b75dd3aa7bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Flow 'volume_create_manager' (cbba333a-f8e2-478b-90c9-1b213061ad8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:15 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b6819fe7-405d-49c3-9bfe-aad81397bbac tempest-CreateVolumesFromSnapshotTest-424301949 None] Created volume successfully. Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Flow 'volume_create_manager' (4c20202a-7309-4324-8e44-c16ce60bd5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb705d86-ae46-4497-95a4-a29626ba7e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb705d86-ae46-4497-95a4-a29626ba7e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3afd31a-1605-4e20-bf78-33adb226d5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f0e6ec2a7243b6b8d1f2c44336e97d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:16Z,use_quota=True,user_id='37457263706d45e7982fc2c190cc5f87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48d01a1b-501d-4dad-8525-406376182353),volume_type_id=48d01a1b-501d-4dad-8525-406376182353)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461aea6d-f9ea-4215-8dd4-003df06cab63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461aea6d-f9ea-4215-8dd4-003df06cab63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ed4ea8-126f-4073-8853-9f7334a77feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:15 devstack cinder-volume[87676]: DEBUG cinder.image.glance [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Creating Keystone auth plugin from conf {{(pid=87676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Flow 'volume_create_manager' (b52aed5d-d6b1-4bc6-830b-b85dd4dbaca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea399d5-35a3-4594-ab72-170b126f5958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea399d5-35a3-4594-ab72-170b126f5958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-132654378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0548d00e-265d-4f1b-a273-d032f10f3bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf130b551064a4aa98fb7d374adf573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:16Z,use_quota=True,user_id='d063a034f3b840269736234d497d4dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a129c260-95a4-4bf9-a9de-deb15d944911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a129c260-95a4-4bf9-a9de-deb15d944911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07efe2c-8828-4608-8fcd-79a5a9d6b151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07efe2c-8828-4608-8fcd-79a5a9d6b151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0548d00e-265d-4f1b-a273-d032f10f3bdd', 'volume_name': 'volume-0548d00e-265d-4f1b-a273-d032f10f3bdd', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f37b18f-123c-466a-8c9e-103e081f10de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f37b18f-123c-466a-8c9e-103e081f10de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4251cc7-56be-43e6-bc6c-008505dcc17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:16 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Volume 0548d00e-265d-4f1b-a273-d032f10f3bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0548d00e-265d-4f1b-a273-d032f10f3bdd', 'volume_size': 1} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-132654378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0548d00e-265d-4f1b-a273-d032f10f3bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf130b551064a4aa98fb7d374adf573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:16Z,use_quota=True,user_id='d063a034f3b840269736234d497d4dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Creating volume 0548d00e-265d-4f1b-a273-d032f10f3bdd {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:16 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:16 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd 1073741824 Jul 19 17:50:16 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ed4ea8-126f-4073-8853-9f7334a77feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a3afd31a-1605-4e20-bf78-33adb226d5b2', 'volume_name': 'volume-a3afd31a-1605-4e20-bf78-33adb226d5b2', 'volume_size': 1, 'image_id': 'c192cdb8-5704-4aac-b3d5-e9856bef2556', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c192cdb8-5704-4aac-b3d5-e9856bef2556', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '539c99cb38e9485647d35dd9d0c8f235', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47f0e6ec2a7243b6b8d1f2c44336e97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8f78117feb27bdaa3de0b0e35e8bdbe772387c0338f0b5c9128ca4f260ed8542c92215174f1340a66cc42edca048c74416dd80bff0a221a506d326da19fa4e88', 'id': 'c192cdb8-5704-4aac-b3d5-e9856bef2556', 'created_at': datetime.datetime(2026, 7, 19, 15, 50, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 50, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c192cdb8-5704-4aac-b3d5-e9856bef2556/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1cdd65c-e56c-4b63-a37a-1d085f066958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1cdd65c-e56c-4b63-a37a-1d085f066958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfb0f85-685a-4079-97e6-84f98539eddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:16 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Volume a3afd31a-1605-4e20-bf78-33adb226d5b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a3afd31a-1605-4e20-bf78-33adb226d5b2', 'volume_size': 1, 'image_id': 'c192cdb8-5704-4aac-b3d5-e9856bef2556', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c192cdb8-5704-4aac-b3d5-e9856bef2556', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '539c99cb38e9485647d35dd9d0c8f235', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47f0e6ec2a7243b6b8d1f2c44336e97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8f78117feb27bdaa3de0b0e35e8bdbe772387c0338f0b5c9128ca4f260ed8542c92215174f1340a66cc42edca048c74416dd80bff0a221a506d326da19fa4e88', 'id': 'c192cdb8-5704-4aac-b3d5-e9856bef2556', 'created_at': datetime.datetime(2026, 7, 19, 15, 50, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 50, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c192cdb8-5704-4aac-b3d5-e9856bef2556/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Trying to clone a3afd31a-1605-4e20-bf78-33adb226d5b2 from image c192cdb8-5704-4aac-b3d5-e9856bef2556 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c192cdb8-5704-4aac-b3d5-e9856bef2556', 'metadata': {}}]). {{(pid=87676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 17:50:16 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Image download 0.00 MB at 0.00 MB/s Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97cbf36-db5e-4169-87ee-5eb7c6043124]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:16 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD Jul 19 17:50:16 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:16 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd 1073741824" returned: 0 in 0.578s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:16 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd Jul 19 17:50:16 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:16 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:17 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD Jul 19 17:50:17 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:17 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd" returned: 0 in 0.315s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.098s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] Creating offline snapshot 89c56f1e-7256-4b2b-b70b-9559171bcb83 of volume c8900234-6a3d-43f6-8e37-fc94aeffd4df {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4251cc7-56be-43e6-bc6c-008505dcc17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0548d00e-265d-4f1b-a273-d032f10f3bdd', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719e789b-e556-46ab-b7d4-2490cec01f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffcafb9-4140-4dea-89bc-6f248324d9b7]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:17 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Volume volume-0548d00e-265d-4f1b-a273-d032f10f3bdd (0548d00e-265d-4f1b-a273-d032f10f3bdd): created successfully Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719e789b-e556-46ab-b7d4-2490cec01f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Flow 'volume_create_manager' (b52aed5d-d6b1-4bc6-830b-b85dd4dbaca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:17 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a2533ee9-502a-4ec0-844a-005d19a2805f tempest-SnapshotDependencyTests-131291028 None] Created volume successfully. Jul 19 17:50:17 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD" returned: 1 in 0.330s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Temporary image c192cdb8-5704-4aac-b3d5-e9856bef2556 is fetched for user 37457263706d45e7982fc2c190cc5f87. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 17:50:17 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df Jul 19 17:50:17 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e57972d-414f-49ca-9c67-fc7baf31f610]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:17 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD Jul 19 17:50:17 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:17 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df" returned: 0 in 0.388s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:17 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83 1G Jul 19 17:50:17 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:17 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:17 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD Jul 19 17:50:17 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:17 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83 1G" returned: 0 in 0.438s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:18 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83 Jul 19 17:50:18 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:18 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:50:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:18 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83" returned: 0 in 0.322s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:18 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83 is being set with open permissions: ugo+rw Jul 19 17:50:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:18 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83 Jul 19 17:50:18 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:18 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83" returned: 0 in 0.243s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:18 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.info Jul 19 17:50:18 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:18 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.info" returned: 0 in 0.248s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:18 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.info is being set with open permissions: ugo+rw Jul 19 17:50:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:18 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.info Jul 19 17:50:18 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:19 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.info" returned: 0 in 0.257s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.983s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.050s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3afd31a-1605-4e20-bf78-33adb226d5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f0e6ec2a7243b6b8d1f2c44336e97d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:16Z,use_quota=True,user_id='37457263706d45e7982fc2c190cc5f87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48d01a1b-501d-4dad-8525-406376182353),volume_type_id=48d01a1b-501d-4dad-8525-406376182353)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Creating volume a3afd31a-1605-4e20-bf78-33adb226d5b2 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:19 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:19 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2 1073741824 Jul 19 17:50:19 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:19 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-483a8dc3-bd7a-4109-a80b-06e7747c0038 tempest-CreateVolumesFromSnapshotTest-424301949 None] Create snapshot completed successfully Jul 19 17:50:19 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2 1073741824" returned: 0 in 0.423s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:19 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2 Jul 19 17:50:19 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:19 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2" returned: 0 in 0.245s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.445s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] Creating offline snapshot 0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc of volume 0548d00e-265d-4f1b-a273-d032f10f3bdd {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Attempting download of c192cdb8-5704-4aac-b3d5-e9856bef2556 ((None, [{'url': 'file:///opt/stack/data/glance/images/c192cdb8-5704-4aac-b3d5-e9856bef2556', 'metadata': {}}])) to volume a3afd31a-1605-4e20-bf78-33adb226d5b2. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0869839-43f3-473c-a3cb-f7fed7ff99b5]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6b32af-5b8b-4425-811f-b69c1bca6b9f]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c192cdb8-5704-4aac-b3d5-e9856bef2556_hm_n0job {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:19 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd Jul 19 17:50:19 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:20 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c192cdb8-5704-4aac-b3d5-e9856bef2556_hm_n0job Jul 19 17:50:20 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:20 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd" returned: 0 in 0.377s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:20 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c192cdb8-5704-4aac-b3d5-e9856bef2556_hm_n0job" returned: 0 in 0.342s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c192cdb8-5704-4aac-b3d5-e9856bef2556_hm_n0job {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:20 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc 1G Jul 19 17:50:20 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:20 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c192cdb8-5704-4aac-b3d5-e9856bef2556_hm_n0job Jul 19 17:50:20 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:20 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Flow 'volume_create_manager' (62feafbb-1f95-4b62-9ee5-3ede479eff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893bc926-27a5-4c83-a583-d4491bb0196e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c192cdb8-5704-4aac-b3d5-e9856bef2556_hm_n0job" returned: 1 in 0.424s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c192cdb8-5704-4aac-b3d5-e9856bef2556_hm_n0job' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbe895e-cbe8-49cc-afb9-d47103192b72]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893bc926-27a5-4c83-a583-d4491bb0196e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1870769409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163c89a3-51ec-49b5-b5bf-c89d513793f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950c61ecfee42afb6462031d6e2a897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:21Z,use_quota=True,user_id='62907f48f55b4266bc151744bd96c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4053745c-aa19-4045-bd1a-dae265b3bcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4053745c-aa19-4045-bd1a-dae265b3bcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65326c85-4109-4d9e-9216-08453ee4a1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:20 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65326c85-4109-4d9e-9216-08453ee4a1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '163c89a3-51ec-49b5-b5bf-c89d513793f9', 'volume_name': 'volume-163c89a3-51ec-49b5-b5bf-c89d513793f9', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff14e29-eb71-4d40-9a8e-2e7b99f3265f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff14e29-eb71-4d40-9a8e-2e7b99f3265f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205d04f6-b862-4786-8792-3add417db0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:20 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume 163c89a3-51ec-49b5-b5bf-c89d513793f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-163c89a3-51ec-49b5-b5bf-c89d513793f9', 'volume_size': 1} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc 1G" returned: 0 in 0.558s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0548d00e-265d-4f1b-a273-d032f10f3bdd -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:20 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0548d00e-265d-4f1b-a273-d032f10f3bdd -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc Jul 19 17:50:20 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:20 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD Jul 19 17:50:20 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Flow 'volume_create_manager' (487d70b2-6c0b-45eb-a30d-39ce8fefdb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b13e06b-4cd7-47da-89be-1be848097ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b13e06b-4cd7-47da-89be-1be848097ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1069443000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39232ded-43dc-40a7-954b-6ebdc63258b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950c61ecfee42afb6462031d6e2a897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:21Z,use_quota=True,user_id='62907f48f55b4266bc151744bd96c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a37814a-c0b3-4930-ae9e-cc1453dc3fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a37814a-c0b3-4930-ae9e-cc1453dc3fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d3971f-cb59-4273-b699-8a89a1ced212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d3971f-cb59-4273-b699-8a89a1ced212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39232ded-43dc-40a7-954b-6ebdc63258b6', 'volume_name': 'volume-39232ded-43dc-40a7-954b-6ebdc63258b6', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374a864d-cd63-4590-9041-fd3bea78bda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374a864d-cd63-4590-9041-fd3bea78bda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2567d62-c993-4efc-82c8-71530fe70631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:21 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume 39232ded-43dc-40a7-954b-6ebdc63258b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39232ded-43dc-40a7-954b-6ebdc63258b6', 'volume_size': 1} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:21 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0548d00e-265d-4f1b-a273-d032f10f3bdd -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc" returned: 0 in 0.433s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:21 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc is being set with open permissions: ugo+rw Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:21 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc Jul 19 17:50:21 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:21 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD" returned: 0 in 0.618s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:21 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD Jul 19 17:50:21 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:21 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc" returned: 0 in 0.311s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:21 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.info Jul 19 17:50:21 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Flow 'volume_create_manager' (8c5b71c9-72ae-474e-9494-2051c09a960e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf609e3-18b6-4478-a007-683eeead48c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:21 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] c192cdb8-5704-4aac-b3d5-e9856bef2556 was raw, converting to qcow2 {{(pid=87676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf609e3-18b6-4478-a007-683eeead48c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1466471103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950c61ecfee42afb6462031d6e2a897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:22Z,use_quota=True,user_id='62907f48f55b4266bc151744bd96c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:21 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2 Jul 19 17:50:21 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422ad1f0-d34b-4f69-90fd-b9d1d36baffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422ad1f0-d34b-4f69-90fd-b9d1d36baffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ea9014-b81d-4c3a-9dcb-5c82f994a40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ea9014-b81d-4c3a-9dcb-5c82f994a40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7', 'volume_name': 'volume-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e55c54-5ffb-4c59-b1a0-f618c62dd2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e55c54-5ffb-4c59-b1a0-f618c62dd2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa4bea2-455d-4b29-ae28-948937628eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:21 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume 0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7', 'volume_size': 1} Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:21 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.info" returned: 0 in 0.321s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:21 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.info is being set with open permissions: ugo+rw Jul 19 17:50:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:21 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.info Jul 19 17:50:21 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Flow 'volume_create_manager' (6812cce5-eafc-4ceb-9d01-220d46d9aa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1271a08-b094-417c-964d-05470921e912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1271a08-b094-417c-964d-05470921e912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1293020048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652d26b4-5ec2-465f-937f-40477dec27ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950c61ecfee42afb6462031d6e2a897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:22Z,use_quota=True,user_id='62907f48f55b4266bc151744bd96c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d680c8c-0c12-4b2f-91a3-d94076c53143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d680c8c-0c12-4b2f-91a3-d94076c53143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d25ee52-471d-46ce-b6d7-3014e001fecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d25ee52-471d-46ce-b6d7-3014e001fecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '652d26b4-5ec2-465f-937f-40477dec27ac', 'volume_name': 'volume-652d26b4-5ec2-465f-937f-40477dec27ac', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98c7bfc-3276-42fa-903e-c3d254f0f48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98c7bfc-3276-42fa-903e-c3d254f0f48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f62b39-bf1d-418f-af4a-44436c686be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:22 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume 652d26b4-5ec2-465f-937f-40477dec27ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-652d26b4-5ec2-465f-937f-40477dec27ac', 'volume_size': 1} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:22 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2" returned: 0 in 0.547s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c192cdb8-5704-4aac-b3d5-e9856bef2556_vw6u8qaodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:50:22 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Converted 0.00 MB image at 0.00 MB/s Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:22 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.info" returned: 0 in 0.336s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:22 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2 1G Jul 19 17:50:22 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.471s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1870769409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163c89a3-51ec-49b5-b5bf-c89d513793f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950c61ecfee42afb6462031d6e2a897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:21Z,use_quota=True,user_id='62907f48f55b4266bc151744bd96c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Creating volume 163c89a3-51ec-49b5-b5bf-c89d513793f9 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:22 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-163c89a3-51ec-49b5-b5bf-c89d513793f9 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:22 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-163c89a3-51ec-49b5-b5bf-c89d513793f9 1073741824 Jul 19 17:50:22 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:22 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-53531c80-9e40-4d52-acf5-2b71abde1927 tempest-SnapshotDependencyTests-131291028 None] Create snapshot completed successfully Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Flow 'volume_create_manager' (c6cb5d4a-8904-4436-8cf2-d4837238957a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85af8c4-8369-490d-bf3b-9102f9a987a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85af8c4-8369-490d-bf3b-9102f9a987a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-569521839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb85f8f9-ea87-4a63-8937-9c4652d638d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950c61ecfee42afb6462031d6e2a897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:22Z,use_quota=True,user_id='62907f48f55b4266bc151744bd96c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a918795e-21b2-4ef3-ba9b-4c309e165ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a918795e-21b2-4ef3-ba9b-4c309e165ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0706dba3-bf21-4948-be12-ff2db336c82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0706dba3-bf21-4948-be12-ff2db336c82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb85f8f9-ea87-4a63-8937-9c4652d638d5', 'volume_name': 'volume-eb85f8f9-ea87-4a63-8937-9c4652d638d5', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9517f7-5a71-4bd7-896a-2bdc4a407737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9517f7-5a71-4bd7-896a-2bdc4a407737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0335621e-078d-4d4c-ab26-88842b638bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:22 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume eb85f8f9-ea87-4a63-8937-9c4652d638d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb85f8f9-ea87-4a63-8937-9c4652d638d5', 'volume_size': 1} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:22 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2 1G" returned: 0 in 0.343s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Downloaded image c192cdb8-5704-4aac-b3d5-e9856bef2556 ((None, [{'url': 'file:///opt/stack/data/glance/images/c192cdb8-5704-4aac-b3d5-e9856bef2556', 'metadata': {}}])) to volume a3afd31a-1605-4e20-bf78-33adb226d5b2 successfully. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Temporary image c192cdb8-5704-4aac-b3d5-e9856bef2556 for user 37457263706d45e7982fc2c190cc5f87 is deleted. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Marking volume a3afd31a-1605-4e20-bf78-33adb226d5b2 as bootable. {{(pid=87676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Copying metadata from image c192cdb8-5704-4aac-b3d5-e9856bef2556 to a3afd31a-1605-4e20-bf78-33adb226d5b2. {{(pid=87676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Creating volume glance metadata for volume a3afd31a-1605-4e20-bf78-33adb226d5b2 backed by image c192cdb8-5704-4aac-b3d5-e9856bef2556 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c192cdb8-5704-4aac-b3d5-e9856bef2556', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '539c99cb38e9485647d35dd9d0c8f235', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfb0f85-685a-4079-97e6-84f98539eddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3afd31a-1605-4e20-bf78-33adb226d5b2', 'volume_size': 1, 'image_id': 'c192cdb8-5704-4aac-b3d5-e9856bef2556', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c192cdb8-5704-4aac-b3d5-e9856bef2556', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '539c99cb38e9485647d35dd9d0c8f235', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47f0e6ec2a7243b6b8d1f2c44336e97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8f78117feb27bdaa3de0b0e35e8bdbe772387c0338f0b5c9128ca4f260ed8542c92215174f1340a66cc42edca048c74416dd80bff0a221a506d326da19fa4e88', 'id': 'c192cdb8-5704-4aac-b3d5-e9856bef2556', 'created_at': datetime.datetime(2026, 7, 19, 15, 50, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 50, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c192cdb8-5704-4aac-b3d5-e9856bef2556/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9692f6c-d056-4fcf-8571-9abe83b37cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:22 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Volume volume-a3afd31a-1605-4e20-bf78-33adb226d5b2 (a3afd31a-1605-4e20-bf78-33adb226d5b2): created successfully Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9692f6c-d056-4fcf-8571-9abe83b37cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Flow 'volume_create_manager' (4c20202a-7309-4324-8e44-c16ce60bd5ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:22 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-e000242c-0ed7-46bf-ba6c-fd4b101302dc tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Created volume successfully. Jul 19 17:50:22 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-163c89a3-51ec-49b5-b5bf-c89d513793f9 1073741824" returned: 0 in 0.486s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-163c89a3-51ec-49b5-b5bf-c89d513793f9 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:22 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-163c89a3-51ec-49b5-b5bf-c89d513793f9 Jul 19 17:50:22 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:23 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-163c89a3-51ec-49b5-b5bf-c89d513793f9" returned: 0 in 0.258s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.904s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1069443000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39232ded-43dc-40a7-954b-6ebdc63258b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950c61ecfee42afb6462031d6e2a897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:21Z,use_quota=True,user_id='62907f48f55b4266bc151744bd96c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Creating volume 39232ded-43dc-40a7-954b-6ebdc63258b6 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:23 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-39232ded-43dc-40a7-954b-6ebdc63258b6 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205d04f6-b862-4786-8792-3add417db0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-163c89a3-51ec-49b5-b5bf-c89d513793f9', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:23 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-39232ded-43dc-40a7-954b-6ebdc63258b6 1073741824 Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bca2b6-f55e-4235-aaf1-adb0d774d439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:23 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:23 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume volume-163c89a3-51ec-49b5-b5bf-c89d513793f9 (163c89a3-51ec-49b5-b5bf-c89d513793f9): created successfully Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bca2b6-f55e-4235-aaf1-adb0d774d439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Flow 'volume_create_manager' (62feafbb-1f95-4b62-9ee5-3ede479eff81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-3a39d8a8-b712-4d00-90d9-077d26f5d944 tempest-CreateVolumesFromSnapshotTest-424301949 None] Created volume successfully. Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Flow 'volume_create_manager' (2bee960d-cb9e-46b3-8a98-516ad0bef920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1af7656-d57f-484b-bb28-724f0049d40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1af7656-d57f-484b-bb28-724f0049d40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489b715d-a995-4899-bf6c-58fcd0856133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf130b551064a4aa98fb7d374adf573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:23Z,use_quota=True,user_id='d063a034f3b840269736234d497d4dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c69824-c9c9-4f34-a81f-8c47f0536cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c69824-c9c9-4f34-a81f-8c47f0536cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ebdf13-9c1d-4cf5-a59f-1bbe35d0037f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ebdf13-9c1d-4cf5-a59f-1bbe35d0037f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '489b715d-a995-4899-bf6c-58fcd0856133', 'volume_name': 'volume-489b715d-a995-4899-bf6c-58fcd0856133', 'volume_size': 1, 'snapshot_id': '0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a051d1-8c99-4b18-8787-e2e4aa5ffaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a051d1-8c99-4b18-8787-e2e4aa5ffaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21aa967-5dcd-4d72-a7c1-f13a089ce9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:23 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Volume 489b715d-a995-4899-bf6c-58fcd0856133: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-489b715d-a995-4899-bf6c-58fcd0856133', 'volume_size': 1, 'snapshot_id': '0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc'} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Acquiring lock "cinder-a3afd31a-1605-4e20-bf78-33adb226d5b2-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Lock "cinder-a3afd31a-1605-4e20-bf78-33adb226d5b2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Acquiring lock "cinder-quobyte-a3afd31a-1605-4e20-bf78-33adb226d5b2" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Lock "cinder-quobyte-a3afd31a-1605-4e20-bf78-33adb226d5b2" acquired by "delete_volume" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e71343d-7963-4195-b07a-2cf7b1e2fdc2]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:23 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2 Jul 19 17:50:23 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:23 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-39232ded-43dc-40a7-954b-6ebdc63258b6 1073741824" returned: 0 in 0.470s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-39232ded-43dc-40a7-954b-6ebdc63258b6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:23 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-39232ded-43dc-40a7-954b-6ebdc63258b6 Jul 19 17:50:23 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:23 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2" returned: 0 in 0.382s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:23 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2 Jul 19 17:50:23 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:23 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-39232ded-43dc-40a7-954b-6ebdc63258b6" returned: 0 in 0.251s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.102s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1466471103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950c61ecfee42afb6462031d6e2a897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:22Z,use_quota=True,user_id='62907f48f55b4266bc151744bd96c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Creating volume 0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:23 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2567d62-c993-4efc-82c8-71530fe70631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39232ded-43dc-40a7-954b-6ebdc63258b6', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f6eb72-ca38-4613-92ed-4230422db932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:23 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7 1073741824 Jul 19 17:50:23 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:23 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume volume-39232ded-43dc-40a7-954b-6ebdc63258b6 (39232ded-43dc-40a7-954b-6ebdc63258b6): created successfully Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f6eb72-ca38-4613-92ed-4230422db932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Flow 'volume_create_manager' (487d70b2-6c0b-45eb-a30d-39ce8fefdb89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-6fdc7408-2e7b-4437-8949-eafc41e5ec22 tempest-CreateVolumesFromSnapshotTest-424301949 None] Created volume successfully. Jul 19 17:50:24 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a3afd31a-1605-4e20-bf78-33adb226d5b2" returned: 0 in 0.258s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Lock "cinder-quobyte-a3afd31a-1605-4e20-bf78-33adb226d5b2" released by "delete_volume" :: held 0.692s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:24 devstack cinder-volume[87676]: WARNING cinder.quota [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:50:24 devstack cinder-volume[87676]: WARNING cinder.quota [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Created reservations ['b4fda764-9843-4bf5-b577-01864b7f18c1', '6934d799-9875-419a-a0a1-737328c68f75', '89a10949-ded0-4286-bbe2-dd9b5b5d9f78', '998a6b53-ed7d-4f1a-85b5-7d9c79097250'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:24 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:24 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:24 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7 1073741824" returned: 0 in 0.485s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:24 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7 Jul 19 17:50:24 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:24 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.280s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:24 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Deleted volume successfully. Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-84bc5ab7-4f36-4db7-b9f9-b124d484a33c tempest-VolumeAndVolumeTypeFromImageTest-2044675983 None] Lock "cinder-a3afd31a-1605-4e20-bf78-33adb226d5b2-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:24 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7" returned: 0 in 0.275s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.562s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1293020048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652d26b4-5ec2-465f-937f-40477dec27ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950c61ecfee42afb6462031d6e2a897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:22Z,use_quota=True,user_id='62907f48f55b4266bc151744bd96c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Creating volume 652d26b4-5ec2-465f-937f-40477dec27ac {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:24 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-652d26b4-5ec2-465f-937f-40477dec27ac 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:24 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-652d26b4-5ec2-465f-937f-40477dec27ac 1073741824 Jul 19 17:50:24 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa4bea2-455d-4b29-ae28-948937628eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5780747-9cee-4665-bd33-89c38499a3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:24 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume volume-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7 (0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7): created successfully Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5780747-9cee-4665-bd33-89c38499a3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Flow 'volume_create_manager' (8c5b71c9-72ae-474e-9494-2051c09a960e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:24 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-d29f251d-a7c7-40d5-878f-2e33eb565373 tempest-CreateVolumesFromSnapshotTest-424301949 None] Created volume successfully. Jul 19 17:50:25 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-652d26b4-5ec2-465f-937f-40477dec27ac 1073741824" returned: 0 in 0.444s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-652d26b4-5ec2-465f-937f-40477dec27ac {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:25 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-652d26b4-5ec2-465f-937f-40477dec27ac Jul 19 17:50:25 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:25 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-652d26b4-5ec2-465f-937f-40477dec27ac" returned: 0 in 0.260s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.982s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-569521839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb85f8f9-ea87-4a63-8937-9c4652d638d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9950c61ecfee42afb6462031d6e2a897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:22Z,use_quota=True,user_id='62907f48f55b4266bc151744bd96c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Creating volume eb85f8f9-ea87-4a63-8937-9c4652d638d5 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:25 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eb85f8f9-ea87-4a63-8937-9c4652d638d5 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f62b39-bf1d-418f-af4a-44436c686be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-652d26b4-5ec2-465f-937f-40477dec27ac', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:25 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eb85f8f9-ea87-4a63-8937-9c4652d638d5 1073741824 Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38adcbc4-8142-4694-b5a3-e35e94af913c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:25 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:25 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume volume-652d26b4-5ec2-465f-937f-40477dec27ac (652d26b4-5ec2-465f-937f-40477dec27ac): created successfully Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38adcbc4-8142-4694-b5a3-e35e94af913c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Flow 'volume_create_manager' (6812cce5-eafc-4ceb-9d01-220d46d9aa6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:25 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b07e43d5-cf2d-40aa-949b-e4e110d8ebe0 tempest-CreateVolumesFromSnapshotTest-424301949 None] Created volume successfully. Jul 19 17:50:25 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eb85f8f9-ea87-4a63-8937-9c4652d638d5 1073741824" returned: 0 in 0.513s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eb85f8f9-ea87-4a63-8937-9c4652d638d5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:26 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eb85f8f9-ea87-4a63-8937-9c4652d638d5 Jul 19 17:50:26 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:26 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eb85f8f9-ea87-4a63-8937-9c4652d638d5" returned: 0 in 0.267s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.962s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "cinder-quobyte-0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc-489b715d-a995-4899-bf6c-58fcd0856133" by "_create_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0335621e-078d-4d4c-ab26-88842b638bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb85f8f9-ea87-4a63-8937-9c4652d638d5', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f23dec-bd8f-432a-aeb5-832d873c4a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-quobyte-0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc-489b715d-a995-4899-bf6c-58fcd0856133" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Creating volume 489b715d-a995-4899-bf6c-58fcd0856133 from snapshot 0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc {{(pid=87676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "cinder-quobyte-489b715d-a995-4899-bf6c-58fcd0856133" by "_copy_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:26 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Volume volume-eb85f8f9-ea87-4a63-8937-9c4652d638d5 (eb85f8f9-ea87-4a63-8937-9c4652d638d5): created successfully Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f23dec-bd8f-432a-aeb5-832d873c4a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Flow 'volume_create_manager' (c6cb5d4a-8904-4436-8cf2-d4837238957a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-quobyte-489b715d-a995-4899-bf6c-58fcd0856133" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] snapshot: 0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc, volume: 489b715d-a995-4899-bf6c-58fcd0856133, {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 17:50:26 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-df317fab-5c79-43ed-b45e-98234d515eb7 tempest-CreateVolumesFromSnapshotTest-424301949 None] Created volume successfully. Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1ed254-5456-4d57-b5ed-15cf77ff1823]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:26 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc Jul 19 17:50:26 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:26 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc" returned: 0 in 0.389s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0548d00e-265d-4f1b-a273-d032f10f3bdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] will copy from snapshot at /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Creating direct copy from snapshot {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b478e5ae-7235-4858-ac1b-a8c5bce35592]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:26 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd Jul 19 17:50:26 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "cinder-eb85f8f9-ea87-4a63-8937-9c4652d638d5-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-eb85f8f9-ea87-4a63-8937-9c4652d638d5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "cinder-quobyte-eb85f8f9-ea87-4a63-8937-9c4652d638d5" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-quobyte-eb85f8f9-ea87-4a63-8937-9c4652d638d5" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:27 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b565c1d-10f6-4a31-a964-b85716a4c9a2]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eb85f8f9-ea87-4a63-8937-9c4652d638d5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:27 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd" returned: 0 in 0.408s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:27 devstack cinder-volume[87676]: DEBUG cinder.utils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Path /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-489b715d-a995-4899-bf6c-58fcd0856133 not found in is_blk_device check {{(pid=87676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 17:50:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-489b715d-a995-4899-bf6c-58fcd0856133 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:27 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eb85f8f9-ea87-4a63-8937-9c4652d638d5 Jul 19 17:50:27 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:27 devstack sudo[103158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-489b715d-a995-4899-bf6c-58fcd0856133 Jul 19 17:50:27 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:27 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eb85f8f9-ea87-4a63-8937-9c4652d638d5" returned: 0 in 0.415s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eb85f8f9-ea87-4a63-8937-9c4652d638d5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:27 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eb85f8f9-ea87-4a63-8937-9c4652d638d5 Jul 19 17:50:27 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:27 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eb85f8f9-ea87-4a63-8937-9c4652d638d5" returned: 0 in 0.342s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-quobyte-eb85f8f9-ea87-4a63-8937-9c4652d638d5" released by "delete_volume" :: held 0.835s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:28 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Created reservations ['7acc3f14-7170-45ff-a404-3e2ed02fe14a', '9322f745-347c-4ca1-baff-afa730962a1c', '81bb0174-202d-445f-9915-0a50dbb5d400', '1cbc8914-7384-4d8f-94e7-200e1cbec1bf'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:28 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:28 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:29 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.800s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:29 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:29 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Deleted volume successfully. Jul 19 17:50:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4825d39a-9eae-46eb-af58-2921374ae1ed tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-eb85f8f9-ea87-4a63-8937-9c4652d638d5-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "cinder-652d26b4-5ec2-465f-937f-40477dec27ac-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-652d26b4-5ec2-465f-937f-40477dec27ac-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "cinder-quobyte-652d26b4-5ec2-465f-937f-40477dec27ac" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-quobyte-652d26b4-5ec2-465f-937f-40477dec27ac" acquired by "delete_volume" :: waited 0.050s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:29 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cb01d9-75a3-438f-b7fa-fc225acba4d8]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-652d26b4-5ec2-465f-937f-40477dec27ac {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:30 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-652d26b4-5ec2-465f-937f-40477dec27ac Jul 19 17:50:30 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:31 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-652d26b4-5ec2-465f-937f-40477dec27ac" returned: 0 in 1.295s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-652d26b4-5ec2-465f-937f-40477dec27ac {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:31 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-652d26b4-5ec2-465f-937f-40477dec27ac Jul 19 17:50:31 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:31 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Flow 'volume_create_manager' (01dc63bb-8ea3-490a-bed4-82a8bd5309ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf62e14b-ffad-4317-a554-4f319541a869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf62e14b-ffad-4317-a554-4f319541a869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2034586039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be09ebad-911b-4a38-a1be-66950fc0f505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b12501144ac4e2aaf3c98e3865a7f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:31Z,use_quota=True,user_id='e28844407ebe485e827087446d1a71b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6119983d-2a63-4379-974d-1049daaf26ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6119983d-2a63-4379-974d-1049daaf26ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7602f51-be45-4eea-9629-b85e275575f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7602f51-be45-4eea-9629-b85e275575f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be09ebad-911b-4a38-a1be-66950fc0f505', 'volume_name': 'volume-be09ebad-911b-4a38-a1be-66950fc0f505', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a147efd-00ff-4de6-a3f5-6270f9ae5943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a147efd-00ff-4de6-a3f5-6270f9ae5943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ab0a74-02dd-498f-842b-d2c7174eb90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:31 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Volume be09ebad-911b-4a38-a1be-66950fc0f505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be09ebad-911b-4a38-a1be-66950fc0f505', 'volume_size': 1} Jul 19 17:50:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:31 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-652d26b4-5ec2-465f-937f-40477dec27ac" returned: 0 in 0.807s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-quobyte-652d26b4-5ec2-465f-937f-40477dec27ac" released by "delete_volume" :: held 2.226s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Created reservations ['c323530f-f6fc-4688-b6c1-adc4bff5d090', '0eeb50f4-36cc-438b-8001-12b5d5480432', '4fbd8e5e-dc04-45d1-8599-38c6a818eb06', 'fabef8d6-4315-4a75-a3a2-081b7aed0282'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Flow 'volume_create_manager' (b2480f8d-7dc2-42c8-a365-4aa3d41ab0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46989469-2609-4809-b2c9-3de935418764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46989469-2609-4809-b2c9-3de935418764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-797096968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aecf317d-39cb-4535-b55f-d75bafad82bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b12501144ac4e2aaf3c98e3865a7f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:32Z,use_quota=True,user_id='e28844407ebe485e827087446d1a71b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29950e18-d389-4a25-9c33-1523a74027fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29950e18-d389-4a25-9c33-1523a74027fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37f526f-180a-4114-8bb4-74d9491d9c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37f526f-180a-4114-8bb4-74d9491d9c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aecf317d-39cb-4535-b55f-d75bafad82bb', 'volume_name': 'volume-aecf317d-39cb-4535-b55f-d75bafad82bb', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5be184e-ee94-4a5d-b5f1-31076d537da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5be184e-ee94-4a5d-b5f1-31076d537da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542615ac-352d-4ded-90ec-c36f23254040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:32 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:32 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Volume aecf317d-39cb-4535-b55f-d75bafad82bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aecf317d-39cb-4535-b55f-d75bafad82bb', 'volume_size': 1} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-489b715d-a995-4899-bf6c-58fcd0856133" returned: 0 in 5.360s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1e9040-bf29-4cc3-9703-338ef45174c9]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:32 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:32 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:32 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd Jul 19 17:50:32 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:32 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Flow 'volume_create_manager' (04740377-2875-4cac-acce-297c08681504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657a92e6-ed28-40d5-a704-168fdcba4b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.325s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:32 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Deleted volume successfully. Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657a92e6-ed28-40d5-a704-168fdcba4b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-196514882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06938e92-8dc5-460f-acdf-4dfb6489c853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b12501144ac4e2aaf3c98e3865a7f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:33Z,use_quota=True,user_id='e28844407ebe485e827087446d1a71b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3163ce-1d33-42e3-b735-5e96247ac699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3163ce-1d33-42e3-b735-5e96247ac699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f2d226-ce0d-451c-8788-b34db32ac928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f2d226-ce0d-451c-8788-b34db32ac928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06938e92-8dc5-460f-acdf-4dfb6489c853', 'volume_name': 'volume-06938e92-8dc5-460f-acdf-4dfb6489c853', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039a724e-afad-4a22-9918-d20bd5bb8cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039a724e-afad-4a22-9918-d20bd5bb8cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78220190-95d9-45a5-a5fe-51370670b23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:33 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Volume 06938e92-8dc5-460f-acdf-4dfb6489c853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06938e92-8dc5-460f-acdf-4dfb6489c853', 'volume_size': 1} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-00c978c0-c2c2-4e49-9fce-ae521829cc5a tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-652d26b4-5ec2-465f-937f-40477dec27ac-delete_volume" released by "delete_volume" :: held 3.448s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "cinder-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "cinder-quobyte-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-quobyte-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Flow 'volume_create_manager' (a2c237f1-72e3-45fa-823a-cd164825bbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde18a89-8568-4240-8ca1-c23aad4652d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:33 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e365678d-bc1c-48e7-9d96-766a3f737c2b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd" returned: 0 in 0.724s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Image conversion details: src /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-489b715d-a995-4899-bf6c-58fcd0856133 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:50:33 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Converted 1024.00 MB image at 191.01 MB/s Jul 19 17:50:33 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-489b715d-a995-4899-bf6c-58fcd0856133 is being set with open permissions: ugo+rw Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-489b715d-a995-4899-bf6c-58fcd0856133 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde18a89-8568-4240-8ca1-c23aad4652d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-537554093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b71a00-725e-4430-8db7-680db566cf1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b12501144ac4e2aaf3c98e3865a7f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:33Z,use_quota=True,user_id='e28844407ebe485e827087446d1a71b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:33 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-489b715d-a995-4899-bf6c-58fcd0856133 Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd408c4-33f7-4cea-82d1-8aacadf50696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:33 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd408c4-33f7-4cea-82d1-8aacadf50696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af8f519-40b6-4423-a6da-66af95f509cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af8f519-40b6-4423-a6da-66af95f509cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b71a00-725e-4430-8db7-680db566cf1b', 'volume_name': 'volume-62b71a00-725e-4430-8db7-680db566cf1b', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36db7508-5b25-46a3-b2ff-07070b0def84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36db7508-5b25-46a3-b2ff-07070b0def84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab0c89a-9304-4079-8c83-0419b593d6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:33 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Volume 62b71a00-725e-4430-8db7-680db566cf1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b71a00-725e-4430-8db7-680db566cf1b', 'volume_size': 1} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:33 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7 Jul 19 17:50:33 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:33 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-489b715d-a995-4899-bf6c-58fcd0856133" returned: 0 in 0.289s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-quobyte-489b715d-a995-4899-bf6c-58fcd0856133" released by "_copy_volume_from_snapshot" :: held 7.310s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Flow 'volume_create_manager' (20bf1e7d-a2da-4e86-bc5e-f68b354be679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8458863b-3a4e-469a-90b8-d7436522dccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-quobyte-0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc-489b715d-a995-4899-bf6c-58fcd0856133" released by "_create_volume_from_snapshot" :: held 7.397s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.435s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.176s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2034586039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be09ebad-911b-4a38-a1be-66950fc0f505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b12501144ac4e2aaf3c98e3865a7f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:31Z,use_quota=True,user_id='e28844407ebe485e827087446d1a71b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Creating volume be09ebad-911b-4a38-a1be-66950fc0f505 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:33 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be09ebad-911b-4a38-a1be-66950fc0f505 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:33 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:33 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be09ebad-911b-4a38-a1be-66950fc0f505 1073741824 Jul 19 17:50:33 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8458863b-3a4e-469a-90b8-d7436522dccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1307844553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5fd800-4c3b-4461-bb61-84b15eacd776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b12501144ac4e2aaf3c98e3865a7f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:34Z,use_quota=True,user_id='e28844407ebe485e827087446d1a71b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2dfd80-43b9-4b5c-a40c-c63163a114cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2dfd80-43b9-4b5c-a40c-c63163a114cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f92263-71fa-45e4-8b49-717d21f19244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f92263-71fa-45e4-8b49-717d21f19244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb5fd800-4c3b-4461-bb61-84b15eacd776', 'volume_name': 'volume-fb5fd800-4c3b-4461-bb61-84b15eacd776', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8f67d6-1a87-4f44-a736-38250346abf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8f67d6-1a87-4f44-a736-38250346abf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1961c3-35c2-442b-84e1-af867b235db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:33 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Volume fb5fd800-4c3b-4461-bb61-84b15eacd776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb5fd800-4c3b-4461-bb61-84b15eacd776', 'volume_size': 1} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7" returned: 0 in 0.448s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:33 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7 Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21aa967-5dcd-4d72-a7c1-f13a089ce9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-489b715d-a995-4899-bf6c-58fcd0856133', 'volume_size': 1, 'snapshot_id': '0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:33 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7cddf2-4e91-405c-82bd-db04c5fde2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:33 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Volume volume-489b715d-a995-4899-bf6c-58fcd0856133 (489b715d-a995-4899-bf6c-58fcd0856133): created successfully Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7cddf2-4e91-405c-82bd-db04c5fde2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Flow 'volume_create_manager' (2bee960d-cb9e-46b3-8a98-516ad0bef920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:33 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-2d8140ad-47a7-450a-bede-253f02519f50 tempest-SnapshotDependencyTests-131291028 None] Created volume successfully. Jul 19 17:50:34 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7" returned: 0 in 0.264s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-quobyte-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7" released by "delete_volume" :: held 0.782s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Created reservations ['3ac7e742-3d5e-49c8-8cfa-544568f19649', '284d249f-ef3f-43b4-8e97-4b287f48bd63', '5326a44a-89a7-45c7-b3b8-0ae1625a63d3', '4ffbb4ca-c445-461e-9bcb-56ba9bb8a0f2'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:34 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be09ebad-911b-4a38-a1be-66950fc0f505 1073741824" returned: 0 in 0.457s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be09ebad-911b-4a38-a1be-66950fc0f505 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:34 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:34 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "cinder-0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:34 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be09ebad-911b-4a38-a1be-66950fc0f505 Jul 19 17:50:34 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "cinder-quobyte-0548d00e-265d-4f1b-a273-d032f10f3bdd" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-quobyte-0548d00e-265d-4f1b-a273-d032f10f3bdd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "cinder-quobyte-0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-quobyte-0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Deleting offline snapshot 0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc of volume 0548d00e-265d-4f1b-a273-d032f10f3bdd {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] snapshot_file for this snap is: volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9d4711-12d8-48f1-bf5c-e4d13088426f]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "cinder-39232ded-43dc-40a7-954b-6ebdc63258b6-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-39232ded-43dc-40a7-954b-6ebdc63258b6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:34 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.307s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:34 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Deleted volume successfully. Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "cinder-quobyte-39232ded-43dc-40a7-954b-6ebdc63258b6" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:34 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be09ebad-911b-4a38-a1be-66950fc0f505" returned: 0 in 0.330s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.980s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-797096968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aecf317d-39cb-4535-b55f-d75bafad82bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b12501144ac4e2aaf3c98e3865a7f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:32Z,use_quota=True,user_id='e28844407ebe485e827087446d1a71b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Creating volume aecf317d-39cb-4535-b55f-d75bafad82bb {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:34 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aecf317d-39cb-4535-b55f-d75bafad82bb 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:34 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc Jul 19 17:50:34 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-quobyte-39232ded-43dc-40a7-954b-6ebdc63258b6" acquired by "delete_volume" :: waited 0.054s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:34 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aecf317d-39cb-4535-b55f-d75bafad82bb 1073741824 Jul 19 17:50:34 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9e24d7e8-8fcd-42eb-a03a-0549f414c8dd tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-0d32ac7d-c6fc-4ed0-b5f7-4d75430382b7-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ab0a74-02dd-498f-842b-d2c7174eb90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be09ebad-911b-4a38-a1be-66950fc0f505', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d75030-04b9-4e66-92d5-75cdf10ea70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2953f14-1c17-47ef-8dd3-062f41e91f38]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-39232ded-43dc-40a7-954b-6ebdc63258b6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:34 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Volume volume-be09ebad-911b-4a38-a1be-66950fc0f505 (be09ebad-911b-4a38-a1be-66950fc0f505): created successfully Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d75030-04b9-4e66-92d5-75cdf10ea70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Flow 'volume_create_manager' (01dc63bb-8ea3-490a-bed4-82a8bd5309ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:34 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-56625604-c949-4a50-98b8-45bcb43c3479 tempest-CreateVolumesFromImageTest-1179945502 None] Created volume successfully. Jul 19 17:50:34 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-39232ded-43dc-40a7-954b-6ebdc63258b6 Jul 19 17:50:34 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:34 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc" returned: 0 in 0.473s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0548d00e-265d-4f1b-a273-d032f10f3bdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[120a100a-059f-474a-96c3-4a5d145a10b7]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:35 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:35 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:35 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd Jul 19 17:50:35 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:35 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aecf317d-39cb-4535-b55f-d75bafad82bb 1073741824" returned: 0 in 0.459s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aecf317d-39cb-4535-b55f-d75bafad82bb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:35 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-39232ded-43dc-40a7-954b-6ebdc63258b6" returned: 0 in 0.442s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-39232ded-43dc-40a7-954b-6ebdc63258b6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:35 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aecf317d-39cb-4535-b55f-d75bafad82bb Jul 19 17:50:35 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:35 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-39232ded-43dc-40a7-954b-6ebdc63258b6 Jul 19 17:50:35 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:35 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.283s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 29 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:50:35 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd" returned: 0 in 0.390s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:35 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc Jul 19 17:50:35 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:35 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aecf317d-39cb-4535-b55f-d75bafad82bb" returned: 0 in 0.290s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:35 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.373s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-196514882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06938e92-8dc5-460f-acdf-4dfb6489c853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b12501144ac4e2aaf3c98e3865a7f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:33Z,use_quota=True,user_id='e28844407ebe485e827087446d1a71b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Creating volume 06938e92-8dc5-460f-acdf-4dfb6489c853 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:35 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-06938e92-8dc5-460f-acdf-4dfb6489c853 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-39232ded-43dc-40a7-954b-6ebdc63258b6" returned: 0 in 0.313s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:35 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-06938e92-8dc5-460f-acdf-4dfb6489c853 1073741824 Jul 19 17:50:35 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542615ac-352d-4ded-90ec-c36f23254040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aecf317d-39cb-4535-b55f-d75bafad82bb', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e16f77-9fb1-4e39-87b1-ef6b2406f48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-quobyte-39232ded-43dc-40a7-954b-6ebdc63258b6" released by "delete_volume" :: held 0.846s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:35 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Volume volume-aecf317d-39cb-4535-b55f-d75bafad82bb (aecf317d-39cb-4535-b55f-d75bafad82bb): created successfully Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e16f77-9fb1-4e39-87b1-ef6b2406f48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Flow 'volume_create_manager' (b2480f8d-7dc2-42c8-a365-4aa3d41ab0b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:35 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ba8c5b95-acee-4128-93b3-ab1cce3da6fe tempest-CreateVolumesFromImageTest-1179945502 None] Created volume successfully. Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Created reservations ['211e1264-1a11-4b39-872e-81619fa8e137', '40951a2c-3cd2-49fc-a698-8fd9839c6e11', 'd5e39fe2-753e-4e7d-968d-3d78d1ef6af3', '755cfc84-dcf9-4846-9ef8-7f89e20f7602'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:35 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:35 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:35 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc" returned: 0 in 0.369s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:35 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc Jul 19 17:50:35 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:35 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-06938e92-8dc5-460f-acdf-4dfb6489c853 1073741824" returned: 0 in 0.501s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:35 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.301s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:35 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:35 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Deleted volume successfully. Jul 19 17:50:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd.0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc" returned: 0 in 0.288s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1292c6d4-d236-4ad8-a9a7-90ffd211933f tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-39232ded-43dc-40a7-954b-6ebdc63258b6-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-06938e92-8dc5-460f-acdf-4dfb6489c853 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-quobyte-0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc" released by "_delete_snapshot" :: held 1.665s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-quobyte-0548d00e-265d-4f1b-a273-d032f10f3bdd" released by "delete_snapshot" :: held 1.709s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:36 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-06938e92-8dc5-460f-acdf-4dfb6489c853 Jul 19 17:50:36 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Created reservations ['6d8fdb08-ba2e-4dd5-86f7-7a5185144cd5', '0f0fe10e-811c-460d-acd1-16b048637815', '071e18f5-b42b-4a24-aad5-86b544d0a812', 'c8ca710d-39c3-46e3-a77e-45251dba5b43'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:36 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Delete snapshot completed successfully. Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f8d70fb5-a742-47f8-999f-a4fbbd76ac05 tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-0b6fd955-83fd-441d-a5e7-8ad3d5c8c5fc-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:36 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-06938e92-8dc5-460f-acdf-4dfb6489c853" returned: 0 in 0.248s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.823s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-537554093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b71a00-725e-4430-8db7-680db566cf1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b12501144ac4e2aaf3c98e3865a7f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:33Z,use_quota=True,user_id='e28844407ebe485e827087446d1a71b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Creating volume 62b71a00-725e-4430-8db7-680db566cf1b {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:36 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-62b71a00-725e-4430-8db7-680db566cf1b 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78220190-95d9-45a5-a5fe-51370670b23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06938e92-8dc5-460f-acdf-4dfb6489c853', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:36 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-62b71a00-725e-4430-8db7-680db566cf1b 1073741824 Jul 19 17:50:36 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a0e7fb-ac55-49e6-b775-ccf108df2901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:36 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Volume volume-06938e92-8dc5-460f-acdf-4dfb6489c853 (06938e92-8dc5-460f-acdf-4dfb6489c853): created successfully Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a0e7fb-ac55-49e6-b775-ccf108df2901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Flow 'volume_create_manager' (04740377-2875-4cac-acce-297c08681504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:36 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-2777501f-9c62-4c48-a477-4947db3288f6 tempest-CreateVolumesFromImageTest-1179945502 None] Created volume successfully. Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "cinder-0548d00e-265d-4f1b-a273-d032f10f3bdd-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-0548d00e-265d-4f1b-a273-d032f10f3bdd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "cinder-quobyte-0548d00e-265d-4f1b-a273-d032f10f3bdd" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-quobyte-0548d00e-265d-4f1b-a273-d032f10f3bdd" acquired by "delete_volume" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea67d25-487d-4604-8e4d-ab9070b0ad91]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:36 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd Jul 19 17:50:36 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:36 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-62b71a00-725e-4430-8db7-680db566cf1b 1073741824" returned: 0 in 0.418s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "cinder-163c89a3-51ec-49b5-b5bf-c89d513793f9-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-62b71a00-725e-4430-8db7-680db566cf1b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-163c89a3-51ec-49b5-b5bf-c89d513793f9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:36 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-62b71a00-725e-4430-8db7-680db566cf1b Jul 19 17:50:36 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "cinder-quobyte-163c89a3-51ec-49b5-b5bf-c89d513793f9" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-quobyte-163c89a3-51ec-49b5-b5bf-c89d513793f9" acquired by "delete_volume" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[face58a3-8432-45cd-9b70-00e216ddb04d]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-163c89a3-51ec-49b5-b5bf-c89d513793f9 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:36 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-163c89a3-51ec-49b5-b5bf-c89d513793f9 Jul 19 17:50:36 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:37 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:37 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd" returned: 0 in 0.444s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-62b71a00-725e-4430-8db7-680db566cf1b" returned: 0 in 0.281s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.225s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1307844553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5fd800-4c3b-4461-bb61-84b15eacd776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b12501144ac4e2aaf3c98e3865a7f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:34Z,use_quota=True,user_id='e28844407ebe485e827087446d1a71b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Creating volume fb5fd800-4c3b-4461-bb61-84b15eacd776 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:37 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd Jul 19 17:50:37 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:37 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb5fd800-4c3b-4461-bb61-84b15eacd776 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab0c89a-9304-4079-8c83-0419b593d6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b71a00-725e-4430-8db7-680db566cf1b', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167fa4fe-5c44-4ba4-94f1-05c8273bfbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:37 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb5fd800-4c3b-4461-bb61-84b15eacd776 1073741824 Jul 19 17:50:37 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:37 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Volume volume-62b71a00-725e-4430-8db7-680db566cf1b (62b71a00-725e-4430-8db7-680db566cf1b): created successfully Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167fa4fe-5c44-4ba4-94f1-05c8273bfbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Flow 'volume_create_manager' (a2c237f1-72e3-45fa-823a-cd164825bbbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:37 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-927ac291-7a6b-4be2-a3af-94bf2964977b tempest-CreateVolumesFromImageTest-1179945502 None] Created volume successfully. Jul 19 17:50:37 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-163c89a3-51ec-49b5-b5bf-c89d513793f9" returned: 0 in 0.415s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-163c89a3-51ec-49b5-b5bf-c89d513793f9 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:37 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0548d00e-265d-4f1b-a273-d032f10f3bdd" returned: 0 in 0.269s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:37 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-163c89a3-51ec-49b5-b5bf-c89d513793f9 Jul 19 17:50:37 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-quobyte-0548d00e-265d-4f1b-a273-d032f10f3bdd" released by "delete_volume" :: held 0.775s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Created reservations ['af4b5b3a-47c1-4bd3-9278-b0911f5bde7d', '8eb7ea0c-af19-4d85-be21-40e3a3a621a3', 'd8d38a04-72fd-4e7f-ae01-87ee4dc4a9f1', 'a33065e8-da17-4213-b037-35214ecd0040'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:37 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:37 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:37 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-163c89a3-51ec-49b5-b5bf-c89d513793f9" returned: 0 in 0.259s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:37 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-quobyte-163c89a3-51ec-49b5-b5bf-c89d513793f9" released by "delete_volume" :: held 0.715s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb5fd800-4c3b-4461-bb61-84b15eacd776 1073741824" returned: 0 in 0.500s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb5fd800-4c3b-4461-bb61-84b15eacd776 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Created reservations ['49e12f46-8b54-48a9-a031-1daa0718da56', '43cba1b2-ae1f-4e54-8edf-856d1167b542', 'f8bcb35d-4160-46b2-b8b1-460fe57bc9e6', 'a5b7df48-c8f4-4b94-9f0e-d1bc104f314a'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:37 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb5fd800-4c3b-4461-bb61-84b15eacd776 Jul 19 17:50:37 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "cinder-489b715d-a995-4899-bf6c-58fcd0856133-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-489b715d-a995-4899-bf6c-58fcd0856133-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:37 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.324s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:37 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Deleted volume successfully. Jul 19 17:50:37 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:37 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "cinder-quobyte-489b715d-a995-4899-bf6c-58fcd0856133" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-quobyte-489b715d-a995-4899-bf6c-58fcd0856133" acquired by "delete_volume" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ca29a33-a95a-4fb0-856d-a6f83a86d23b tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-0548d00e-265d-4f1b-a273-d032f10f3bdd-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bac1728-f9a9-495d-bca7-a7ac45d5bd8e]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-489b715d-a995-4899-bf6c-58fcd0856133 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "cinder-89c56f1e-7256-4b2b-b70b-9559171bcb83-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:37 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb5fd800-4c3b-4461-bb61-84b15eacd776" returned: 0 in 0.336s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-89c56f1e-7256-4b2b-b70b-9559171bcb83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "cinder-quobyte-c8900234-6a3d-43f6-8e37-fc94aeffd4df" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1961c3-35c2-442b-84e1-af867b235db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb5fd800-4c3b-4461-bb61-84b15eacd776', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d19166-3f42-421e-8e01-0e5f6e854b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-quobyte-c8900234-6a3d-43f6-8e37-fc94aeffd4df" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "cinder-quobyte-89c56f1e-7256-4b2b-b70b-9559171bcb83" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:38 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Volume volume-fb5fd800-4c3b-4461-bb61-84b15eacd776 (fb5fd800-4c3b-4461-bb61-84b15eacd776): created successfully Jul 19 17:50:38 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-489b715d-a995-4899-bf6c-58fcd0856133 Jul 19 17:50:38 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d19166-3f42-421e-8e01-0e5f6e854b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Flow 'volume_create_manager' (20bf1e7d-a2da-4e86-bc5e-f68b354be679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-quobyte-89c56f1e-7256-4b2b-b70b-9559171bcb83" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Deleting offline snapshot 89c56f1e-7256-4b2b-b70b-9559171bcb83 of volume c8900234-6a3d-43f6-8e37-fc94aeffd4df {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] snapshot_file for this snap is: volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:50:38 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:38 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-e77502b6-099b-4ecc-a260-e921d9085af6 tempest-CreateVolumesFromImageTest-1179945502 None] Created volume successfully. Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.324s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[290f47d8-1470-4951-9656-447bc39ed9b7]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:38 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Deleted volume successfully. Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-be985708-de98-4346-af62-64e83bb39136 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-163c89a3-51ec-49b5-b5bf-c89d513793f9-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:38 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83 Jul 19 17:50:38 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "cinder-fb5fd800-4c3b-4461-bb61-84b15eacd776-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-fb5fd800-4c3b-4461-bb61-84b15eacd776-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "cinder-quobyte-fb5fd800-4c3b-4461-bb61-84b15eacd776" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-quobyte-fb5fd800-4c3b-4461-bb61-84b15eacd776" acquired by "delete_volume" :: waited 0.015s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:38 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-489b715d-a995-4899-bf6c-58fcd0856133" returned: 0 in 0.505s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-489b715d-a995-4899-bf6c-58fcd0856133 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7408ffb0-c97a-4b22-be38-e08d1e1b715b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb5fd800-4c3b-4461-bb61-84b15eacd776 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:38 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-489b715d-a995-4899-bf6c-58fcd0856133 Jul 19 17:50:38 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:38 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb5fd800-4c3b-4461-bb61-84b15eacd776 Jul 19 17:50:38 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:38 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83" returned: 0 in 0.413s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[13677a6a-12ae-41b2-9cd1-6b395e623d32]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:38 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-489b715d-a995-4899-bf6c-58fcd0856133" returned: 0 in 0.256s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:38 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df Jul 19 17:50:38 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-quobyte-489b715d-a995-4899-bf6c-58fcd0856133" released by "delete_volume" :: held 0.816s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Created reservations ['a5184db9-36dc-4a70-9aed-82e4136c5ec3', 'c784e1a7-92bd-4e24-8a76-ba23dd0a0cb7', '8ea86c5c-95d4-4dee-927b-36d0b44d3d48', 'e471175d-68ab-452f-810c-55fbc5972a5a'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:38 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb5fd800-4c3b-4461-bb61-84b15eacd776" returned: 0 in 0.377s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb5fd800-4c3b-4461-bb61-84b15eacd776 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:38 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb5fd800-4c3b-4461-bb61-84b15eacd776 Jul 19 17:50:38 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:38 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:38 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:38 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df" returned: 0 in 0.424s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:38 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83 Jul 19 17:50:38 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:39 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.266s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:39 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Deleted volume successfully. Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2c793b5a-4cb8-4b8d-be33-07b7de949f14 tempest-SnapshotDependencyTests-131291028 None] Lock "cinder-489b715d-a995-4899-bf6c-58fcd0856133-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:39 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-fb5fd800-4c3b-4461-bb61-84b15eacd776" returned: 0 in 0.354s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-quobyte-fb5fd800-4c3b-4461-bb61-84b15eacd776" released by "delete_volume" :: held 0.794s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Created reservations ['eaa223ef-c803-48da-97b3-25cbf131d9a7', '2938ddeb-8d88-4184-891e-e2cd2e3092a2', '0f477c98-d10e-43cc-9ef1-0c1b135d050e', 'f8ac76c2-1b5f-4732-9855-78404dc60052'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:39 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:39 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:39 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83" returned: 0 in 0.485s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:39 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83 Jul 19 17:50:39 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "cinder-62b71a00-725e-4430-8db7-680db566cf1b-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-62b71a00-725e-4430-8db7-680db566cf1b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:39 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.316s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:39 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Deleted volume successfully. Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "cinder-quobyte-62b71a00-725e-4430-8db7-680db566cf1b" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-adbb213f-02a9-4ee4-aa2f-8dcde7e9a541 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-fb5fd800-4c3b-4461-bb61-84b15eacd776-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-quobyte-62b71a00-725e-4430-8db7-680db566cf1b" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb9fed2-b5af-457c-b01c-79f2bf44aa51]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-62b71a00-725e-4430-8db7-680db566cf1b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:39 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df.89c56f1e-7256-4b2b-b70b-9559171bcb83" returned: 0 in 0.318s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:39 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-62b71a00-725e-4430-8db7-680db566cf1b Jul 19 17:50:39 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-quobyte-89c56f1e-7256-4b2b-b70b-9559171bcb83" released by "_delete_snapshot" :: held 1.795s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-quobyte-c8900234-6a3d-43f6-8e37-fc94aeffd4df" released by "delete_snapshot" :: held 1.834s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Created reservations ['1abd5464-0fd4-4838-a04d-503035e2a593', '9a3218cc-2f54-4855-8eee-e0d2d85a0865', '5314e415-6360-4089-b8ba-a18c20231dc1', '9eaa709c-f542-497d-8495-5f71ab87e8b8'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:39 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Delete snapshot completed successfully. Jul 19 17:50:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b52a5808-2233-4a45-a73b-1e11841dd155 tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-89c56f1e-7256-4b2b-b70b-9559171bcb83-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:40 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-62b71a00-725e-4430-8db7-680db566cf1b" returned: 0 in 0.452s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-62b71a00-725e-4430-8db7-680db566cf1b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:40 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-62b71a00-725e-4430-8db7-680db566cf1b Jul 19 17:50:40 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "cinder-c8900234-6a3d-43f6-8e37-fc94aeffd4df-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-c8900234-6a3d-43f6-8e37-fc94aeffd4df-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "cinder-quobyte-c8900234-6a3d-43f6-8e37-fc94aeffd4df" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-quobyte-c8900234-6a3d-43f6-8e37-fc94aeffd4df" acquired by "delete_volume" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[388f81b4-7a6f-40cf-8fe5-522fb6d988f7]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:40 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-62b71a00-725e-4430-8db7-680db566cf1b" returned: 0 in 0.276s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:40 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df Jul 19 17:50:40 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-quobyte-62b71a00-725e-4430-8db7-680db566cf1b" released by "delete_volume" :: held 0.777s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Created reservations ['2fd85031-fc8c-4451-89ed-2c3c70805373', '89139db3-4ff3-4ab7-bfc6-5e6825e260f9', '073a79b8-e784-418d-a743-e50c3069aba2', 'db188157-5d3b-481d-9132-1dcc90ab56b6'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:40 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:40 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:40 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "cinder-06938e92-8dc5-460f-acdf-4dfb6489c853-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df" returned: 0 in 0.453s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-06938e92-8dc5-460f-acdf-4dfb6489c853-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:40 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df Jul 19 17:50:40 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "cinder-quobyte-06938e92-8dc5-460f-acdf-4dfb6489c853" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-quobyte-06938e92-8dc5-460f-acdf-4dfb6489c853" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e83694d-99ee-4ed8-9331-f4c1dff2f734]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:40 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-06938e92-8dc5-460f-acdf-4dfb6489c853 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.356s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:40 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Deleted volume successfully. Jul 19 17:50:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-909568c3-d07d-4404-9874-22a09c2e7665 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-62b71a00-725e-4430-8db7-680db566cf1b-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:40 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-06938e92-8dc5-460f-acdf-4dfb6489c853 Jul 19 17:50:40 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:41 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c8900234-6a3d-43f6-8e37-fc94aeffd4df" returned: 0 in 0.343s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-quobyte-c8900234-6a3d-43f6-8e37-fc94aeffd4df" released by "delete_volume" :: held 0.859s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Created reservations ['4f352e44-3fb0-4fce-9aa2-1ab75ff2b573', '43e3b29e-1de1-46d3-97bd-ecb0e7783834', 'e13121d9-88a3-4ae2-8bd4-6f31f7fa6eae', '4e178be0-70df-43fa-b468-6dae22ab0d67'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:41 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:41 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:41 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-06938e92-8dc5-460f-acdf-4dfb6489c853" returned: 0 in 0.431s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-06938e92-8dc5-460f-acdf-4dfb6489c853 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:41 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-06938e92-8dc5-460f-acdf-4dfb6489c853 Jul 19 17:50:41 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:41 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.275s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:41 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Deleted volume successfully. Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ac29e9e7-7155-4e65-bc09-ff81248536cd tempest-CreateVolumesFromSnapshotTest-424301949 None] Lock "cinder-c8900234-6a3d-43f6-8e37-fc94aeffd4df-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:41 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-06938e92-8dc5-460f-acdf-4dfb6489c853" returned: 0 in 0.279s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-quobyte-06938e92-8dc5-460f-acdf-4dfb6489c853" released by "delete_volume" :: held 0.771s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Created reservations ['c8f54f73-1b8c-4c2e-8bf2-9cdbffda1456', '329f12e3-3d87-4bb0-ae3e-86c39498d501', 'ed5e26bf-cb4f-4397-9c06-836081a95b02', 'ead5477c-48fa-4920-bbb0-a04159493087'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:41 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:41 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "cinder-aecf317d-39cb-4535-b55f-d75bafad82bb-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-aecf317d-39cb-4535-b55f-d75bafad82bb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "cinder-quobyte-aecf317d-39cb-4535-b55f-d75bafad82bb" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-quobyte-aecf317d-39cb-4535-b55f-d75bafad82bb" acquired by "delete_volume" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:42 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc38b3b-58a6-411f-8262-6b4ffb7c6408]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aecf317d-39cb-4535-b55f-d75bafad82bb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:42 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.359s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:42 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:42 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Deleted volume successfully. Jul 19 17:50:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9bb8b3a4-16ae-441a-9ede-85916dd2f130 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-06938e92-8dc5-460f-acdf-4dfb6489c853-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:42 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aecf317d-39cb-4535-b55f-d75bafad82bb Jul 19 17:50:42 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:42 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aecf317d-39cb-4535-b55f-d75bafad82bb" returned: 0 in 0.475s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aecf317d-39cb-4535-b55f-d75bafad82bb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:42 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aecf317d-39cb-4535-b55f-d75bafad82bb Jul 19 17:50:42 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:42 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-aecf317d-39cb-4535-b55f-d75bafad82bb" returned: 0 in 0.283s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-quobyte-aecf317d-39cb-4535-b55f-d75bafad82bb" released by "delete_volume" :: held 0.813s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:42 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Created reservations ['31e1bed2-75a8-42eb-ad53-d2c8dd0e9a97', '152f4800-051c-42e9-ae81-0fe43f359663', 'c6f9a071-c92b-4ddb-ac08-0faef878cd7a', 'a5625872-ad45-435b-87f5-a76487460a70'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:43 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:43 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:43 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "cinder-be09ebad-911b-4a38-a1be-66950fc0f505-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:43 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-be09ebad-911b-4a38-a1be-66950fc0f505-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:43 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "cinder-quobyte-be09ebad-911b-4a38-a1be-66950fc0f505" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:43 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-quobyte-be09ebad-911b-4a38-a1be-66950fc0f505" acquired by "delete_volume" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:43 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0ba1d6-2a1f-4b1d-8cf0-d66c430aea23]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be09ebad-911b-4a38-a1be-66950fc0f505 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:43 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.441s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:43 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:43 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Deleted volume successfully. Jul 19 17:50:43 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a9a5adf9-3720-412d-94ce-b9f8771ddc0f tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-aecf317d-39cb-4535-b55f-d75bafad82bb-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:43 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be09ebad-911b-4a38-a1be-66950fc0f505 Jul 19 17:50:43 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:43 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be09ebad-911b-4a38-a1be-66950fc0f505" returned: 0 in 0.466s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be09ebad-911b-4a38-a1be-66950fc0f505 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:43 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be09ebad-911b-4a38-a1be-66950fc0f505 Jul 19 17:50:43 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:44 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be09ebad-911b-4a38-a1be-66950fc0f505" returned: 0 in 0.344s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-quobyte-be09ebad-911b-4a38-a1be-66950fc0f505" released by "delete_volume" :: held 0.870s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:44 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Created reservations ['f1a0c328-f708-4f13-a791-c254d0cd0040', 'af4edc46-d328-44c0-aea3-f50578fb51c8', '12fe13f0-4ba7-4763-a752-e8d5cf5d1f5e', '3c08fbbf-5327-4519-acc2-779220a2e840'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:44 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:44 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:44 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.321s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:44 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:44 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Deleted volume successfully. Jul 19 17:50:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a088790d-63f7-49c0-9ab3-9065207f8900 tempest-CreateVolumesFromImageTest-1179945502 None] Lock "cinder-be09ebad-911b-4a38-a1be-66950fc0f505-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:45 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Flow 'volume_create_manager' (028c698a-4206-471c-8745-f0690c761a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61635102-5e46-4bce-8220-a631180eccc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61635102-5e46-4bce-8220-a631180eccc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-794752837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76a3732-29ad-40fd-bdcd-a9d8dfc851a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='840f288d2cde431f82b1748ff9a8176a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:46Z,use_quota=True,user_id='f08dac2a93f74a3c9b787e08243e589c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2333a2fc-5c3c-4178-b224-6cc092e01d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2333a2fc-5c3c-4178-b224-6cc092e01d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beaa1680-54cd-486d-90cf-ab274c7f6b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beaa1680-54cd-486d-90cf-ab274c7f6b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd76a3732-29ad-40fd-bdcd-a9d8dfc851a3', 'volume_name': 'volume-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f101f9ce-90e9-4e35-8fad-a103c11a7b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f101f9ce-90e9-4e35-8fad-a103c11a7b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971fa472-147a-4809-9d77-a3b4dffebb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:46 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Volume d76a3732-29ad-40fd-bdcd-a9d8dfc851a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3', 'volume_size': 1} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-794752837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76a3732-29ad-40fd-bdcd-a9d8dfc851a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='840f288d2cde431f82b1748ff9a8176a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:46Z,use_quota=True,user_id='f08dac2a93f74a3c9b787e08243e589c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Creating volume d76a3732-29ad-40fd-bdcd-a9d8dfc851a3 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:46 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:46 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3 1073741824 Jul 19 17:50:46 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:46 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3 1073741824" returned: 0 in 0.495s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:46 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3 Jul 19 17:50:46 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:46 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3" returned: 0 in 0.335s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971fa472-147a-4809-9d77-a3b4dffebb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3acab430-450a-41a5-a0d6-9ee35d21ef62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:47 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Volume volume-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3 (d76a3732-29ad-40fd-bdcd-a9d8dfc851a3): created successfully Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3acab430-450a-41a5-a0d6-9ee35d21ef62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Flow 'volume_create_manager' (028c698a-4206-471c-8745-f0690c761a04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:47 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c7264e42-d827-4e20-8713-09854e574799 tempest-ProjectReaderTests-1387227599 None] Created volume successfully. Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Flow 'volume_create_manager' (fb19117f-5097-41fb-ab0a-c2a32410b960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911d14e4-12d7-4696-bb5f-5a51a7e0fab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911d14e4-12d7-4696-bb5f-5a51a7e0fab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1196972785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaea0dc65b9d4fe4b849f8e2117afc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:48Z,use_quota=True,user_id='7bbdcb7e087f4b2e9a4d07df9d422445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb47449-3f75-434a-a31a-38e3baeac18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb47449-3f75-434a-a31a-38e3baeac18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ebb612-4b69-45c1-a538-12211adb0034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ebb612-4b69-45c1-a538-12211adb0034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf', 'volume_name': 'volume-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94130bb-766f-4ed7-9ce8-89cfd0a33e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94130bb-766f-4ed7-9ce8-89cfd0a33e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a91d80e-bc2b-4bac-9bbc-07368290b95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:47 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume 7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf', 'volume_size': 1} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1196972785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaea0dc65b9d4fe4b849f8e2117afc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:48Z,use_quota=True,user_id='7bbdcb7e087f4b2e9a4d07df9d422445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Creating volume 7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:47 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:48 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf 1073741824 Jul 19 17:50:48 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:48 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Acquiring lock "cinder-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:48 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Lock "cinder-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:48 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf 1073741824" returned: 0 in 0.513s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:48 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Acquiring lock "cinder-quobyte-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:48 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Lock "cinder-quobyte-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:48 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf Jul 19 17:50:48 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:48 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f25f36-e6ad-43c2-9681-6a6e1b7dc9f6]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:48 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3 Jul 19 17:50:48 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:48 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf" returned: 0 in 0.299s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a91d80e-bc2b-4bac-9bbc-07368290b95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3936b228-0eba-49db-ac20-8f15ede180f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:48 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume volume-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf (7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf): created successfully Jul 19 17:50:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3936b228-0eba-49db-ac20-8f15ede180f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Flow 'volume_create_manager' (fb19117f-5097-41fb-ab0a-c2a32410b960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:48 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-58bd8092-a251-41ab-92e4-19e28f0d7aaf tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Created volume successfully. Jul 19 17:50:49 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3" returned: 0 in 0.418s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:49 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3 Jul 19 17:50:49 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:49 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3" returned: 0 in 0.263s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Lock "cinder-quobyte-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3" released by "delete_volume" :: held 0.737s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:49 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Created reservations ['e02a098c-7456-438b-b997-6ae45a52cc80', '73b78c73-1ea4-4323-8d58-4f9b8201121a', 'fd73817f-bd8a-4811-9af0-fecd90f89af3', 'c4552756-4531-4a93-b9e5-410b63fb9b65'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:49 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:49 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:49 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.247s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:49 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:49 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Deleted volume successfully. Jul 19 17:50:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5fdc7b87-e682-47ca-b704-48d0b3321cef tempest-ProjectReaderTests-1387227599 None] Lock "cinder-d76a3732-29ad-40fd-bdcd-a9d8dfc851a3-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Flow 'volume_create_manager' (c3f6005f-2bd2-4133-b5d5-15e904c4a187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667ef828-8da6-482d-9159-df8c4d25816c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667ef828-8da6-482d-9159-df8c4d25816c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247099671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c32133e-2a34-4158-9471-9dab83a4dfb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='840f288d2cde431f82b1748ff9a8176a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:50Z,use_quota=True,user_id='f08dac2a93f74a3c9b787e08243e589c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9188c3-9e1e-4e86-ad73-4ab16824f34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9188c3-9e1e-4e86-ad73-4ab16824f34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173ecd39-c964-4a59-aae3-ea2f71073d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173ecd39-c964-4a59-aae3-ea2f71073d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c32133e-2a34-4158-9471-9dab83a4dfb6', 'volume_name': 'volume-6c32133e-2a34-4158-9471-9dab83a4dfb6', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2891375b-8ec1-4304-aeea-e9bd9af1ab70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2891375b-8ec1-4304-aeea-e9bd9af1ab70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71e63d2-c965-4e5b-9db7-913d91aa6dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:50 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Volume 6c32133e-2a34-4158-9471-9dab83a4dfb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c32133e-2a34-4158-9471-9dab83a4dfb6', 'volume_size': 1} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247099671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c32133e-2a34-4158-9471-9dab83a4dfb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='840f288d2cde431f82b1748ff9a8176a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:50Z,use_quota=True,user_id='f08dac2a93f74a3c9b787e08243e589c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Creating volume 6c32133e-2a34-4158-9471-9dab83a4dfb6 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:50 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c32133e-2a34-4158-9471-9dab83a4dfb6 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:50 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c32133e-2a34-4158-9471-9dab83a4dfb6 1073741824 Jul 19 17:50:50 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Flow 'volume_create_manager' (75b5cb96-a271-4330-b722-ad8d095ca941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586e14e7-2870-4936-948c-4582af704063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586e14e7-2870-4936-948c-4582af704063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2035851022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166e32dd-380c-4393-a5b6-aafb4d531175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaea0dc65b9d4fe4b849f8e2117afc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:50Z,use_quota=True,user_id='7bbdcb7e087f4b2e9a4d07df9d422445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b134a9dc-123d-4c41-a8cb-6cee189fd1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b134a9dc-123d-4c41-a8cb-6cee189fd1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e34b2b-3220-4853-a71d-3a00250e7476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e34b2b-3220-4853-a71d-3a00250e7476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '166e32dd-380c-4393-a5b6-aafb4d531175', 'volume_name': 'volume-166e32dd-380c-4393-a5b6-aafb4d531175', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4abc98-2332-43a0-9254-c56830a16138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4abc98-2332-43a0-9254-c56830a16138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5819f9eb-8295-4075-9eaa-9b6947f3df61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:50 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume 166e32dd-380c-4393-a5b6-aafb4d531175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-166e32dd-380c-4393-a5b6-aafb4d531175', 'volume_size': 1} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:50 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c32133e-2a34-4158-9471-9dab83a4dfb6 1073741824" returned: 0 in 0.464s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Flow 'volume_create_manager' (bb7ea052-2238-4a25-a508-fbfcdd47ce5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcdeea23-dfc9-46bf-b431-547b636c17c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c32133e-2a34-4158-9471-9dab83a4dfb6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcdeea23-dfc9-46bf-b431-547b636c17c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1745232182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c33aeb-e690-4d8a-8568-1cee3aca05b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaea0dc65b9d4fe4b849f8e2117afc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:51Z,use_quota=True,user_id='7bbdcb7e087f4b2e9a4d07df9d422445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:50 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c32133e-2a34-4158-9471-9dab83a4dfb6 Jul 19 17:50:50 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0207c4d1-9fb3-449b-9439-27bcb3f91da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0207c4d1-9fb3-449b-9439-27bcb3f91da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85aca826-89ae-427d-9843-bb79ce68806e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85aca826-89ae-427d-9843-bb79ce68806e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99c33aeb-e690-4d8a-8568-1cee3aca05b1', 'volume_name': 'volume-99c33aeb-e690-4d8a-8568-1cee3aca05b1', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11b9ecc-af75-433c-b026-90da36c9e399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11b9ecc-af75-433c-b026-90da36c9e399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78efffc7-bd43-4b4f-935b-fdb6eeeba707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:50 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume 99c33aeb-e690-4d8a-8568-1cee3aca05b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99c33aeb-e690-4d8a-8568-1cee3aca05b1', 'volume_size': 1} Jul 19 17:50:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:51 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c32133e-2a34-4158-9471-9dab83a4dfb6" returned: 0 in 0.276s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2035851022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166e32dd-380c-4393-a5b6-aafb4d531175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaea0dc65b9d4fe4b849f8e2117afc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:50Z,use_quota=True,user_id='7bbdcb7e087f4b2e9a4d07df9d422445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Creating volume 166e32dd-380c-4393-a5b6-aafb4d531175 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:51 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-166e32dd-380c-4393-a5b6-aafb4d531175 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:51 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-166e32dd-380c-4393-a5b6-aafb4d531175 1073741824 Jul 19 17:50:51 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71e63d2-c965-4e5b-9db7-913d91aa6dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c32133e-2a34-4158-9471-9dab83a4dfb6', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6973af85-bc61-4158-bd84-489b780f69b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Volume volume-6c32133e-2a34-4158-9471-9dab83a4dfb6 (6c32133e-2a34-4158-9471-9dab83a4dfb6): created successfully Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6973af85-bc61-4158-bd84-489b780f69b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Flow 'volume_create_manager' (c3f6005f-2bd2-4133-b5d5-15e904c4a187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Flow 'volume_create_manager' (441c5ed6-a317-4d57-8311-1cc418c3f85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50f5e8f-6961-4883-bfdc-e6cf5cdbb283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f8054cfe-6873-428f-8108-7ef132898b3e tempest-ProjectReaderTests-1387227599 None] Created volume successfully. Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50f5e8f-6961-4883-bfdc-e6cf5cdbb283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-33064429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a199f02f-6fce-4e69-95de-c1fd85aa0d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaea0dc65b9d4fe4b849f8e2117afc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:51Z,use_quota=True,user_id='7bbdcb7e087f4b2e9a4d07df9d422445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25aee779-0909-485c-9c6f-574377deb4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25aee779-0909-485c-9c6f-574377deb4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc722401-22a8-493a-9147-4bc2ee5e961e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc722401-22a8-493a-9147-4bc2ee5e961e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a199f02f-6fce-4e69-95de-c1fd85aa0d96', 'volume_name': 'volume-a199f02f-6fce-4e69-95de-c1fd85aa0d96', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a25d1d-915f-4954-8f48-056c88352b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a25d1d-915f-4954-8f48-056c88352b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24f9a05-0e12-4326-9515-fe415a6e3d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume a199f02f-6fce-4e69-95de-c1fd85aa0d96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a199f02f-6fce-4e69-95de-c1fd85aa0d96', 'volume_size': 1} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Flow 'volume_create_manager' (8f5a6180-61e7-4103-ad4b-77c56d5089db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31381c7e-4281-4bc8-8506-5910e6fca31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31381c7e-4281-4bc8-8506-5910e6fca31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660244310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab137bb5-b956-4e60-bdb3-3aa137eb1096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaea0dc65b9d4fe4b849f8e2117afc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:51Z,use_quota=True,user_id='7bbdcb7e087f4b2e9a4d07df9d422445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fb2745-3799-4a4c-93a4-3ce69f11c317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fb2745-3799-4a4c-93a4-3ce69f11c317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:51 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b35f84-46d2-45b5-8c0c-148493442873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b35f84-46d2-45b5-8c0c-148493442873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab137bb5-b956-4e60-bdb3-3aa137eb1096', 'volume_name': 'volume-ab137bb5-b956-4e60-bdb3-3aa137eb1096', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567a20d5-e18e-4382-be0c-389cb0eb3edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567a20d5-e18e-4382-be0c-389cb0eb3edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a75bb83-d29c-4736-99fe-f95e531e0bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume ab137bb5-b956-4e60-bdb3-3aa137eb1096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab137bb5-b956-4e60-bdb3-3aa137eb1096', 'volume_size': 1} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-166e32dd-380c-4393-a5b6-aafb4d531175 1073741824" returned: 0 in 0.504s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-166e32dd-380c-4393-a5b6-aafb4d531175 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:51 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-166e32dd-380c-4393-a5b6-aafb4d531175 Jul 19 17:50:51 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Flow 'volume_create_manager' (687094ac-4033-4563-bb01-71c10ebb680a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beaadea7-4d6b-4119-b539-82bc6adb9ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beaadea7-4d6b-4119-b539-82bc6adb9ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-741147700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11485796-c691-4315-8d23-cb98e01cfec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaea0dc65b9d4fe4b849f8e2117afc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:52Z,use_quota=True,user_id='7bbdcb7e087f4b2e9a4d07df9d422445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:51 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb7a4aa-7e3f-4553-a09d-696ed914e18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb7a4aa-7e3f-4553-a09d-696ed914e18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f432e3-4a37-4883-a45d-fb34ffcda8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f432e3-4a37-4883-a45d-fb34ffcda8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11485796-c691-4315-8d23-cb98e01cfec0', 'volume_name': 'volume-11485796-c691-4315-8d23-cb98e01cfec0', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78b071e-9a74-4c67-bad3-03d4e954ee61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78b071e-9a74-4c67-bad3-03d4e954ee61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139a7838-3ddd-42dd-86c3-d6035f88ac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume 11485796-c691-4315-8d23-cb98e01cfec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11485796-c691-4315-8d23-cb98e01cfec0', 'volume_size': 1} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-166e32dd-380c-4393-a5b6-aafb4d531175" returned: 0 in 0.310s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.086s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1745232182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c33aeb-e690-4d8a-8568-1cee3aca05b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaea0dc65b9d4fe4b849f8e2117afc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:51Z,use_quota=True,user_id='7bbdcb7e087f4b2e9a4d07df9d422445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Creating volume 99c33aeb-e690-4d8a-8568-1cee3aca05b1 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:51 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-99c33aeb-e690-4d8a-8568-1cee3aca05b1 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5819f9eb-8295-4075-9eaa-9b6947f3df61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-166e32dd-380c-4393-a5b6-aafb4d531175', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:51 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-99c33aeb-e690-4d8a-8568-1cee3aca05b1 1073741824 Jul 19 17:50:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dfa1e10-55e6-4ee9-857b-3e0bb2c93604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:51 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:52 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume volume-166e32dd-380c-4393-a5b6-aafb4d531175 (166e32dd-380c-4393-a5b6-aafb4d531175): created successfully Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dfa1e10-55e6-4ee9-857b-3e0bb2c93604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Flow 'volume_create_manager' (75b5cb96-a271-4330-b722-ad8d095ca941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:52 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-061bba38-ed1c-408d-a8fc-4e9d64c3fc4e tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Created volume successfully. Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Acquiring lock "cinder-6c32133e-2a34-4158-9471-9dab83a4dfb6-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Lock "cinder-6c32133e-2a34-4158-9471-9dab83a4dfb6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Acquiring lock "cinder-quobyte-6c32133e-2a34-4158-9471-9dab83a4dfb6" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Lock "cinder-quobyte-6c32133e-2a34-4158-9471-9dab83a4dfb6" acquired by "delete_volume" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a89073c-a9d0-4a2c-8a44-ebaa449cbf0f]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c32133e-2a34-4158-9471-9dab83a4dfb6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:52 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-99c33aeb-e690-4d8a-8568-1cee3aca05b1 1073741824" returned: 0 in 0.490s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-99c33aeb-e690-4d8a-8568-1cee3aca05b1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:52 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c32133e-2a34-4158-9471-9dab83a4dfb6 Jul 19 17:50:52 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:52 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-99c33aeb-e690-4d8a-8568-1cee3aca05b1 Jul 19 17:50:52 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:52 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-99c33aeb-e690-4d8a-8568-1cee3aca05b1" returned: 0 in 0.244s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.462s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-33064429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a199f02f-6fce-4e69-95de-c1fd85aa0d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaea0dc65b9d4fe4b849f8e2117afc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:51Z,use_quota=True,user_id='7bbdcb7e087f4b2e9a4d07df9d422445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Creating volume a199f02f-6fce-4e69-95de-c1fd85aa0d96 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:52 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a199f02f-6fce-4e69-95de-c1fd85aa0d96 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:52 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c32133e-2a34-4158-9471-9dab83a4dfb6" returned: 0 in 0.368s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c32133e-2a34-4158-9471-9dab83a4dfb6 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:52 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a199f02f-6fce-4e69-95de-c1fd85aa0d96 1073741824 Jul 19 17:50:52 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78efffc7-bd43-4b4f-935b-fdb6eeeba707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c33aeb-e690-4d8a-8568-1cee3aca05b1', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:52 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c32133e-2a34-4158-9471-9dab83a4dfb6 Jul 19 17:50:52 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b031cd-1768-44e8-9774-2f058d08779b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:52 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume volume-99c33aeb-e690-4d8a-8568-1cee3aca05b1 (99c33aeb-e690-4d8a-8568-1cee3aca05b1): created successfully Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b031cd-1768-44e8-9774-2f058d08779b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Flow 'volume_create_manager' (bb7ea052-2238-4a25-a508-fbfcdd47ce5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:52 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-726049b3-45aa-4a81-9463-d47a9ce744e1 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Created volume successfully. Jul 19 17:50:53 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c32133e-2a34-4158-9471-9dab83a4dfb6" returned: 0 in 0.277s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Lock "cinder-quobyte-6c32133e-2a34-4158-9471-9dab83a4dfb6" released by "delete_volume" :: held 0.683s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Created reservations ['df76df4b-9a11-4f35-aa9c-4d1e43f3adc4', 'ecc54d40-71a5-4762-a3f6-cff79c8e28a6', '7542579d-ffc0-4ad0-abd4-23d4464515f9', 'ae2c015c-f238-4e82-b741-e0047daf6a90'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:53 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:53 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:53 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a199f02f-6fce-4e69-95de-c1fd85aa0d96 1073741824" returned: 0 in 0.472s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a199f02f-6fce-4e69-95de-c1fd85aa0d96 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:53 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a199f02f-6fce-4e69-95de-c1fd85aa0d96 Jul 19 17:50:53 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:53 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.264s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:53 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Deleted volume successfully. Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e760bba4-6610-4cd8-8c8d-c4166be84ec4 tempest-ProjectReaderTests-1387227599 None] Lock "cinder-6c32133e-2a34-4158-9471-9dab83a4dfb6-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:53 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a199f02f-6fce-4e69-95de-c1fd85aa0d96" returned: 0 in 0.265s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.912s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660244310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab137bb5-b956-4e60-bdb3-3aa137eb1096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaea0dc65b9d4fe4b849f8e2117afc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:51Z,use_quota=True,user_id='7bbdcb7e087f4b2e9a4d07df9d422445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Creating volume ab137bb5-b956-4e60-bdb3-3aa137eb1096 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:53 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ab137bb5-b956-4e60-bdb3-3aa137eb1096 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:53 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ab137bb5-b956-4e60-bdb3-3aa137eb1096 1073741824 Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24f9a05-0e12-4326-9515-fe415a6e3d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a199f02f-6fce-4e69-95de-c1fd85aa0d96', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:53 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b69076-04b2-4850-9250-8464eb9d2c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:53 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume volume-a199f02f-6fce-4e69-95de-c1fd85aa0d96 (a199f02f-6fce-4e69-95de-c1fd85aa0d96): created successfully Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b69076-04b2-4850-9250-8464eb9d2c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Flow 'volume_create_manager' (441c5ed6-a317-4d57-8311-1cc418c3f85b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:53 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c8ba40ed-221d-4356-81c8-fc618559759f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Created volume successfully. Jul 19 17:50:53 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ab137bb5-b956-4e60-bdb3-3aa137eb1096 1073741824" returned: 0 in 0.456s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ab137bb5-b956-4e60-bdb3-3aa137eb1096 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:54 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ab137bb5-b956-4e60-bdb3-3aa137eb1096 Jul 19 17:50:54 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:54 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ab137bb5-b956-4e60-bdb3-3aa137eb1096" returned: 0 in 0.257s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.340s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-741147700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11485796-c691-4315-8d23-cb98e01cfec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaea0dc65b9d4fe4b849f8e2117afc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:50:52Z,use_quota=True,user_id='7bbdcb7e087f4b2e9a4d07df9d422445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Creating volume 11485796-c691-4315-8d23-cb98e01cfec0 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:50:54 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-11485796-c691-4315-8d23-cb98e01cfec0 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a75bb83-d29c-4736-99fe-f95e531e0bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab137bb5-b956-4e60-bdb3-3aa137eb1096', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758040d9-9aaa-49c7-b460-e051f89e687d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:54 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-11485796-c691-4315-8d23-cb98e01cfec0 1073741824 Jul 19 17:50:54 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:54 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume volume-ab137bb5-b956-4e60-bdb3-3aa137eb1096 (ab137bb5-b956-4e60-bdb3-3aa137eb1096): created successfully Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758040d9-9aaa-49c7-b460-e051f89e687d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Flow 'volume_create_manager' (8f5a6180-61e7-4103-ad4b-77c56d5089db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:54 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-44c119a4-7918-4f22-b175-792bb70dba18 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Created volume successfully. Jul 19 17:50:54 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-11485796-c691-4315-8d23-cb98e01cfec0 1073741824" returned: 0 in 0.456s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-11485796-c691-4315-8d23-cb98e01cfec0 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:54 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-11485796-c691-4315-8d23-cb98e01cfec0 Jul 19 17:50:54 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:55 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-11485796-c691-4315-8d23-cb98e01cfec0" returned: 0 in 0.271s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:50:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139a7838-3ddd-42dd-86c3-d6035f88ac4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11485796-c691-4315-8d23-cb98e01cfec0', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4527fc6c-be89-4d3d-8833-1ad95d6ec115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:50:55 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Volume volume-11485796-c691-4315-8d23-cb98e01cfec0 (11485796-c691-4315-8d23-cb98e01cfec0): created successfully Jul 19 17:50:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4527fc6c-be89-4d3d-8833-1ad95d6ec115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:50:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Flow 'volume_create_manager' (687094ac-4033-4563-bb01-71c10ebb680a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:50:55 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-324b6630-3de2-4dc1-a369-6110524c116f tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Created volume successfully. Jul 19 17:50:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "cinder-11485796-c691-4315-8d23-cb98e01cfec0-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-11485796-c691-4315-8d23-cb98e01cfec0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "cinder-quobyte-11485796-c691-4315-8d23-cb98e01cfec0" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-quobyte-11485796-c691-4315-8d23-cb98e01cfec0" acquired by "delete_volume" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:55 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf47d9f-451e-4acf-88b7-c9d0c190743c]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-11485796-c691-4315-8d23-cb98e01cfec0 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:55 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-11485796-c691-4315-8d23-cb98e01cfec0 Jul 19 17:50:55 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:55 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-11485796-c691-4315-8d23-cb98e01cfec0" returned: 0 in 0.413s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-11485796-c691-4315-8d23-cb98e01cfec0 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:55 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-11485796-c691-4315-8d23-cb98e01cfec0 Jul 19 17:50:55 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:56 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-11485796-c691-4315-8d23-cb98e01cfec0" returned: 0 in 0.269s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-quobyte-11485796-c691-4315-8d23-cb98e01cfec0" released by "delete_volume" :: held 0.727s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Created reservations ['1f46e4df-2a73-4e6b-98d6-440890b22edb', '0c8e3978-f169-4fb4-93fb-ca66f90d5c4b', '462eb2f8-bcdd-480b-b95c-908dfea8f83d', '24745cb7-76a2-4d65-b72b-7730bec50805'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:56 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:56 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "cinder-ab137bb5-b956-4e60-bdb3-3aa137eb1096-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:56 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.260s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-ab137bb5-b956-4e60-bdb3-3aa137eb1096-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:56 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Deleted volume successfully. Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a56db7ee-c40f-4f3f-be30-0452a0daa3b6 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-11485796-c691-4315-8d23-cb98e01cfec0-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "cinder-quobyte-ab137bb5-b956-4e60-bdb3-3aa137eb1096" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-quobyte-ab137bb5-b956-4e60-bdb3-3aa137eb1096" acquired by "delete_volume" :: waited 0.013s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc92c27-6856-4a2f-9943-a888d7620381]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ab137bb5-b956-4e60-bdb3-3aa137eb1096 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:56 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ab137bb5-b956-4e60-bdb3-3aa137eb1096 Jul 19 17:50:56 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:56 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ab137bb5-b956-4e60-bdb3-3aa137eb1096" returned: 0 in 0.386s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ab137bb5-b956-4e60-bdb3-3aa137eb1096 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:57 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ab137bb5-b956-4e60-bdb3-3aa137eb1096 Jul 19 17:50:57 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:57 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ab137bb5-b956-4e60-bdb3-3aa137eb1096" returned: 0 in 0.262s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-quobyte-ab137bb5-b956-4e60-bdb3-3aa137eb1096" released by "delete_volume" :: held 0.689s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Created reservations ['d15470d3-9036-4d48-b5a2-975b5a7dff4a', '02be00cf-bf06-44d3-b86e-14160333f248', '43a84b47-1ff6-4eec-98ae-2c91a04c6627', 'd78d3b4c-9fc4-429a-9108-b887ecc11000'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:57 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:57 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "cinder-a199f02f-6fce-4e69-95de-c1fd85aa0d96-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:57 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.304s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-a199f02f-6fce-4e69-95de-c1fd85aa0d96-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:57 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Deleted volume successfully. Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ecff637-29aa-46b8-bfcf-a0636eb6be81 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-ab137bb5-b956-4e60-bdb3-3aa137eb1096-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "cinder-quobyte-a199f02f-6fce-4e69-95de-c1fd85aa0d96" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-quobyte-a199f02f-6fce-4e69-95de-c1fd85aa0d96" acquired by "delete_volume" :: waited 0.015s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[49938eb8-9c31-4768-bea5-e98b3b41bd5f]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a199f02f-6fce-4e69-95de-c1fd85aa0d96 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:57 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a199f02f-6fce-4e69-95de-c1fd85aa0d96 Jul 19 17:50:57 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:58 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a199f02f-6fce-4e69-95de-c1fd85aa0d96" returned: 0 in 0.396s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a199f02f-6fce-4e69-95de-c1fd85aa0d96 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:58 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a199f02f-6fce-4e69-95de-c1fd85aa0d96 Jul 19 17:50:58 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:58 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a199f02f-6fce-4e69-95de-c1fd85aa0d96" returned: 0 in 0.252s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-quobyte-a199f02f-6fce-4e69-95de-c1fd85aa0d96" released by "delete_volume" :: held 0.699s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Created reservations ['143adb6f-c25e-4156-b789-ced1660ccad3', 'b7282d81-2b99-4ddc-9d2b-2fd095fb5386', '921e8c93-7bb3-4160-a312-4e704ffa07af', 'dbdd6698-7ddf-46db-8fb5-d891cc2d2006'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:58 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:58 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:58 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.260s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:50:58 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Deleted volume successfully. Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "cinder-99c33aeb-e690-4d8a-8568-1cee3aca05b1-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-99c33aeb-e690-4d8a-8568-1cee3aca05b1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3538d233-99ed-4365-b4db-75f12178d4a4 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-a199f02f-6fce-4e69-95de-c1fd85aa0d96-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "cinder-quobyte-99c33aeb-e690-4d8a-8568-1cee3aca05b1" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-quobyte-99c33aeb-e690-4d8a-8568-1cee3aca05b1" acquired by "delete_volume" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef51f603-f164-4cd8-9184-4bdb0985106a]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:50:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-99c33aeb-e690-4d8a-8568-1cee3aca05b1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:59 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-99c33aeb-e690-4d8a-8568-1cee3aca05b1 Jul 19 17:50:59 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:59 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-99c33aeb-e690-4d8a-8568-1cee3aca05b1" returned: 0 in 0.380s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-99c33aeb-e690-4d8a-8568-1cee3aca05b1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:59 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-99c33aeb-e690-4d8a-8568-1cee3aca05b1 Jul 19 17:50:59 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:50:59 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Jul 19 17:50:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-99c33aeb-e690-4d8a-8568-1cee3aca05b1" returned: 0 in 0.259s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:50:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-quobyte-99c33aeb-e690-4d8a-8568-1cee3aca05b1" released by "delete_volume" :: held 0.682s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:50:59 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Created reservations ['a2124aca-157a-4e1d-8b18-fe85adec252b', 'a420098e-9629-4fbf-ac8a-f9bf2548e206', '5bdc044c-7769-4c31-8efe-66df127e062c', '13fe3449-15a7-45ab-ac6c-61415908eb07'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:50:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:50:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:50:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:50:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:50:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:50:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:50:59 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:50:59 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "cinder-166e32dd-380c-4393-a5b6-aafb4d531175-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-166e32dd-380c-4393-a5b6-aafb4d531175-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:00 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.300s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "cinder-quobyte-166e32dd-380c-4393-a5b6-aafb4d531175" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:00 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Deleted volume successfully. Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-quobyte-166e32dd-380c-4393-a5b6-aafb4d531175" acquired by "delete_volume" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b6f66a42-112c-4a22-9017-915dda8c78f5 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-99c33aeb-e690-4d8a-8568-1cee3aca05b1-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eff7572-7949-47c4-83af-384404377625]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-166e32dd-380c-4393-a5b6-aafb4d531175 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:00 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-166e32dd-380c-4393-a5b6-aafb4d531175 Jul 19 17:51:00 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:00 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-166e32dd-380c-4393-a5b6-aafb4d531175" returned: 0 in 0.353s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-166e32dd-380c-4393-a5b6-aafb4d531175 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:00 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-166e32dd-380c-4393-a5b6-aafb4d531175 Jul 19 17:51:00 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:00 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-166e32dd-380c-4393-a5b6-aafb4d531175" returned: 0 in 0.238s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-quobyte-166e32dd-380c-4393-a5b6-aafb4d531175" released by "delete_volume" :: held 0.633s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Created reservations ['3167ab6d-ea65-4946-943c-f28dd53d08bc', '9f9a6571-955b-49ad-b9de-cde1720faa16', '1ce6d9dd-e5df-495c-95e9-cb97ca9380f2', '0972ee85-4f7a-4abc-910c-c82d0473a34f'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:00 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:00 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:01 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.240s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:01 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:01 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Deleted volume successfully. Jul 19 17:51:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b0c904bb-4199-41fe-b01e-e02549028c19 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-166e32dd-380c-4393-a5b6-aafb4d531175-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "cinder-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "cinder-quobyte-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-quobyte-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf" acquired by "delete_volume" :: waited 0.015s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:01 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7451ff3-683d-4731-a659-26bb407081b3]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:01 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf Jul 19 17:51:01 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:01 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf" returned: 0 in 0.342s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:01 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf Jul 19 17:51:01 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:01 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf" returned: 0 in 0.241s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-quobyte-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf" released by "delete_volume" :: held 0.621s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:01 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Created reservations ['48a3d2ec-f389-4645-b85c-10412992119e', '05fadddf-6f74-481e-a9ff-08c327260fb0', '5e92463c-5775-4c79-8dc1-d191e6300c6a', '85d3b362-963e-433b-8e80-c1c46e0125c2'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:02 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:02 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:02 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.245s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:02 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:02 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Deleted volume successfully. Jul 19 17:51:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-44cb1a49-f9f7-4273-952e-a84782b27c46 tempest-CreateVolumesFromSourceVolumeTest-1366045843 None] Lock "cinder-7c6988ff-b03c-4ef8-9bc0-268b1cf0eadf-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:12 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=180,cinder:UPDATE=253,cinder:INSERT=60,cinder:DELETE=19 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:51:12 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:UPDATE=261,cinder:SELECT=178,cinder:INSERT=69,cinder:DELETE=27 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:51:17 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Flow 'volume_create_manager' (e1718753-ec6f-4a04-9814-7d4ebb1945b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6b5480-4306-403d-84fd-50ac2e8ef614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6b5480-4306-403d-84fd-50ac2e8ef614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1331224895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02db690f-efe3-4a50-858d-4df2b7a66e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daaf252d1414e92bf166961c43a6bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:18Z,use_quota=True,user_id='9d6a9c0fa1a74fe7b4cec7f7373bb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2e0df6-90d3-489f-b70c-3cde61c5de76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2e0df6-90d3-489f-b70c-3cde61c5de76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45db9f1d-379a-40ce-9bf2-ec1f4e2684f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45db9f1d-379a-40ce-9bf2-ec1f4e2684f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02db690f-efe3-4a50-858d-4df2b7a66e2e', 'volume_name': 'volume-02db690f-efe3-4a50-858d-4df2b7a66e2e', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97df2117-d8ac-4850-b108-db23972ec198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97df2117-d8ac-4850-b108-db23972ec198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e11a1a-7a40-49c1-a743-e656f53faa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:18 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Volume 02db690f-efe3-4a50-858d-4df2b7a66e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02db690f-efe3-4a50-858d-4df2b7a66e2e', 'volume_size': 1} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1331224895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02db690f-efe3-4a50-858d-4df2b7a66e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daaf252d1414e92bf166961c43a6bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:18Z,use_quota=True,user_id='9d6a9c0fa1a74fe7b4cec7f7373bb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Creating volume 02db690f-efe3-4a50-858d-4df2b7a66e2e {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:18 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-02db690f-efe3-4a50-858d-4df2b7a66e2e 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:18 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-02db690f-efe3-4a50-858d-4df2b7a66e2e 1073741824 Jul 19 17:51:18 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Flow 'volume_create_manager' (28b58693-f33f-4dff-bc12-9fa92bd7291a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb5f930-ddf6-4f5d-994e-9b2dd3de4011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb5f930-ddf6-4f5d-994e-9b2dd3de4011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1197575358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3742a0-8575-4216-94f0-99de92477597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b016c8d9694276b4d6474a90ab94fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:19Z,use_quota=True,user_id='557e1d82e4fd4dd580e034eb61cce346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df3f335-6b70-47a8-a8d2-6ac0519872f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df3f335-6b70-47a8-a8d2-6ac0519872f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1930b7e3-35eb-4f92-bbdd-fa983a048abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1930b7e3-35eb-4f92-bbdd-fa983a048abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3742a0-8575-4216-94f0-99de92477597', 'volume_name': 'volume-9a3742a0-8575-4216-94f0-99de92477597', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934c2d10-b379-430f-9f33-cea162921fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934c2d10-b379-430f-9f33-cea162921fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a98c3c3-8d88-4a58-9b29-56d82201063f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:18 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume 9a3742a0-8575-4216-94f0-99de92477597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3742a0-8575-4216-94f0-99de92477597', 'volume_size': 1} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:18 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-02db690f-efe3-4a50-858d-4df2b7a66e2e 1073741824" returned: 0 in 0.645s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Flow 'volume_create_manager' (62ddfb4e-7029-4512-bb02-13ecd85642ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e3bb30-eb00-4e89-98b5-fddb80e8238e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e3bb30-eb00-4e89-98b5-fddb80e8238e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1229047332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658db194-0783-4476-b59b-9efb2d6ae0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daaf252d1414e92bf166961c43a6bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:19Z,use_quota=True,user_id='9d6a9c0fa1a74fe7b4cec7f7373bb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed38018-0a18-4c9e-a589-d256bbb9715e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed38018-0a18-4c9e-a589-d256bbb9715e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd2f8f3-8afb-4ae5-b184-8585936b1ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd2f8f3-8afb-4ae5-b184-8585936b1ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '658db194-0783-4476-b59b-9efb2d6ae0c7', 'volume_name': 'volume-658db194-0783-4476-b59b-9efb2d6ae0c7', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6d6386-504c-4ffe-b356-1b5c652383b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6d6386-504c-4ffe-b356-1b5c652383b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f200538-bd39-400c-8106-3b9398500de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:18 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Volume 658db194-0783-4476-b59b-9efb2d6ae0c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-658db194-0783-4476-b59b-9efb2d6ae0c7', 'volume_size': 1} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:18 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Flow 'volume_create_manager' (62d3277d-d83c-4d18-a977-71e5f2123e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd03aeab-ae96-42a2-90d4-9d9b7a2a8f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-02db690f-efe3-4a50-858d-4df2b7a66e2e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd03aeab-ae96-42a2-90d4-9d9b7a2a8f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1574130837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a334119-632a-4175-9870-cb5591cacbed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daaf252d1414e92bf166961c43a6bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:19Z,use_quota=True,user_id='9d6a9c0fa1a74fe7b4cec7f7373bb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb80c7f-5ca1-4661-ace8-8554dbe377f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb80c7f-5ca1-4661-ace8-8554dbe377f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0d7c71-f199-4c29-a7d4-9bab9df7f678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0d7c71-f199-4c29-a7d4-9bab9df7f678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a334119-632a-4175-9870-cb5591cacbed', 'volume_name': 'volume-7a334119-632a-4175-9870-cb5591cacbed', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874e19c3-043a-426c-9115-3c2489a08180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:19 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-02db690f-efe3-4a50-858d-4df2b7a66e2e Jul 19 17:51:19 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874e19c3-043a-426c-9115-3c2489a08180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33d665c-0fe5-4b25-ab03-1c529e621647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:19 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Volume 7a334119-632a-4175-9870-cb5591cacbed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a334119-632a-4175-9870-cb5591cacbed', 'volume_size': 1} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:19 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Flow 'volume_create_manager' (09646e37-4f02-40af-b5c8-ed3eace69c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3282ff-aa85-4a77-8577-4df85e82ded5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-02db690f-efe3-4a50-858d-4df2b7a66e2e" returned: 0 in 0.444s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.666s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1197575358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3742a0-8575-4216-94f0-99de92477597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b016c8d9694276b4d6474a90ab94fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:19Z,use_quota=True,user_id='557e1d82e4fd4dd580e034eb61cce346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Creating volume 9a3742a0-8575-4216-94f0-99de92477597 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:19 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3282ff-aa85-4a77-8577-4df85e82ded5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-936073021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb99465b-0f3f-4fd6-b640-7ba1f4715759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daaf252d1414e92bf166961c43a6bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:19Z,use_quota=True,user_id='9d6a9c0fa1a74fe7b4cec7f7373bb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7659ca-64aa-4967-9783-d7583d413ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7659ca-64aa-4967-9783-d7583d413ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f196f2-e242-4b57-96ba-403f8ebd3a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:19 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597 1073741824 Jul 19 17:51:19 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f196f2-e242-4b57-96ba-403f8ebd3a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb99465b-0f3f-4fd6-b640-7ba1f4715759', 'volume_name': 'volume-cb99465b-0f3f-4fd6-b640-7ba1f4715759', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1a75d2-c609-4414-9e14-87ba8a102e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1a75d2-c609-4414-9e14-87ba8a102e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a44b73c-6161-43b3-9728-64f094581101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:19 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Volume cb99465b-0f3f-4fd6-b640-7ba1f4715759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb99465b-0f3f-4fd6-b640-7ba1f4715759', 'volume_size': 1} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e11a1a-7a40-49c1-a743-e656f53faa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02db690f-efe3-4a50-858d-4df2b7a66e2e', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733c1895-7635-4aff-83bf-0600d36307fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:19 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Volume volume-02db690f-efe3-4a50-858d-4df2b7a66e2e (02db690f-efe3-4a50-858d-4df2b7a66e2e): created successfully Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733c1895-7635-4aff-83bf-0600d36307fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Flow 'volume_create_manager' (e1718753-ec6f-4a04-9814-7d4ebb1945b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Flow 'volume_create_manager' (84d4bf9f-27b6-4ffd-bd23-2a2806518180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a47a70e-2abf-4db4-8148-a985b33160ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:19 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c1aa7ba3-ed89-43ee-a50f-eb0b62b7b15b tempest-CreateVolumesFromImageTest-1298396920 None] Created volume successfully. Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a47a70e-2abf-4db4-8148-a985b33160ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557290355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbfd5ed-b10c-4826-9042-2d0844e4f6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e059d676114b799ce92d9545b79b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:20Z,use_quota=True,user_id='b379d3427ced404ca91a667c316f6239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc53a92-ce9d-45fe-a183-2eecd90dc09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc53a92-ce9d-45fe-a183-2eecd90dc09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5c8ff7-c35c-4ac5-870e-95d46e275d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5c8ff7-c35c-4ac5-870e-95d46e275d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dbfd5ed-b10c-4826-9042-2d0844e4f6a5', 'volume_name': 'volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c0cdd8-5b4e-4d34-975b-36cae23aad0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c0cdd8-5b4e-4d34-975b-36cae23aad0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2dbd01-4d5b-4a9f-9438-7e2ad1a56395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:19 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Volume 1dbfd5ed-b10c-4826-9042-2d0844e4f6a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5', 'volume_size': 1} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:19 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Flow 'volume_create_manager' (15ad714b-585f-44f6-bf42-8f1a6245fc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040bdb52-3ab0-4689-bd18-e5917667f923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040bdb52-3ab0-4689-bd18-e5917667f923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-363515973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1aba09d-3a40-4995-84c5-b62d74ee4a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daaf252d1414e92bf166961c43a6bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:20Z,use_quota=True,user_id='9d6a9c0fa1a74fe7b4cec7f7373bb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa66bcd-a08e-4f1f-bb98-a0bbf1a834dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa66bcd-a08e-4f1f-bb98-a0bbf1a834dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48281bf2-deec-48df-afdb-03b714f14853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48281bf2-deec-48df-afdb-03b714f14853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1aba09d-3a40-4995-84c5-b62d74ee4a79', 'volume_name': 'volume-a1aba09d-3a40-4995-84c5-b62d74ee4a79', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7e8e1c-2be5-4101-9404-a11ad0906c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7e8e1c-2be5-4101-9404-a11ad0906c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bad132-263e-44ed-a8de-500751b502f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:20 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Volume a1aba09d-3a40-4995-84c5-b62d74ee4a79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1aba09d-3a40-4995-84c5-b62d74ee4a79', 'volume_size': 1} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:20 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597 1073741824" returned: 0 in 0.576s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:20 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597 Jul 19 17:51:20 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:20 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597" returned: 0 in 0.259s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.402s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1229047332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658db194-0783-4476-b59b-9efb2d6ae0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daaf252d1414e92bf166961c43a6bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:19Z,use_quota=True,user_id='9d6a9c0fa1a74fe7b4cec7f7373bb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Creating volume 658db194-0783-4476-b59b-9efb2d6ae0c7 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:20 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-658db194-0783-4476-b59b-9efb2d6ae0c7 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a98c3c3-8d88-4a58-9b29-56d82201063f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3742a0-8575-4216-94f0-99de92477597', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcdfb6c2-afe2-47f3-8192-5f477a038ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:20 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-658db194-0783-4476-b59b-9efb2d6ae0c7 1073741824 Jul 19 17:51:20 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:20 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume volume-9a3742a0-8575-4216-94f0-99de92477597 (9a3742a0-8575-4216-94f0-99de92477597): created successfully Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcdfb6c2-afe2-47f3-8192-5f477a038ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Flow 'volume_create_manager' (28b58693-f33f-4dff-bc12-9fa92bd7291a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:20 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-3829f45c-904a-4587-9be9-5ec436d83d92 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Created volume successfully. Jul 19 17:51:20 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-658db194-0783-4476-b59b-9efb2d6ae0c7 1073741824" returned: 0 in 0.437s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-658db194-0783-4476-b59b-9efb2d6ae0c7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:20 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-658db194-0783-4476-b59b-9efb2d6ae0c7 Jul 19 17:51:20 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:21 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-658db194-0783-4476-b59b-9efb2d6ae0c7" returned: 0 in 0.256s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.004s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1574130837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a334119-632a-4175-9870-cb5591cacbed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daaf252d1414e92bf166961c43a6bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:19Z,use_quota=True,user_id='9d6a9c0fa1a74fe7b4cec7f7373bb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Creating volume 7a334119-632a-4175-9870-cb5591cacbed {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:21 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7a334119-632a-4175-9870-cb5591cacbed 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f200538-bd39-400c-8106-3b9398500de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-658db194-0783-4476-b59b-9efb2d6ae0c7', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c6938d-efc4-4e4d-9ff1-899e128f2373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:21 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7a334119-632a-4175-9870-cb5591cacbed 1073741824 Jul 19 17:51:21 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:21 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Volume volume-658db194-0783-4476-b59b-9efb2d6ae0c7 (658db194-0783-4476-b59b-9efb2d6ae0c7): created successfully Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c6938d-efc4-4e4d-9ff1-899e128f2373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Flow 'volume_create_manager' (62ddfb4e-7029-4512-bb02-13ecd85642ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:21 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-1f011863-7514-4cb3-8853-0016eb9f49a3 tempest-CreateVolumesFromImageTest-1298396920 None] Created volume successfully. Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:21 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7a334119-632a-4175-9870-cb5591cacbed 1073741824" returned: 0 in 0.549s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7a334119-632a-4175-9870-cb5591cacbed {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:21 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7a334119-632a-4175-9870-cb5591cacbed Jul 19 17:51:21 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:22 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7a334119-632a-4175-9870-cb5591cacbed" returned: 0 in 0.335s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.493s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-936073021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb99465b-0f3f-4fd6-b640-7ba1f4715759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daaf252d1414e92bf166961c43a6bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:19Z,use_quota=True,user_id='9d6a9c0fa1a74fe7b4cec7f7373bb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Creating volume cb99465b-0f3f-4fd6-b640-7ba1f4715759 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:22 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb99465b-0f3f-4fd6-b640-7ba1f4715759 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33d665c-0fe5-4b25-ab03-1c529e621647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a334119-632a-4175-9870-cb5591cacbed', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d800919-ec6d-491c-8026-dc74ab61c1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:22 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb99465b-0f3f-4fd6-b640-7ba1f4715759 1073741824 Jul 19 17:51:22 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:22 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Volume volume-7a334119-632a-4175-9870-cb5591cacbed (7a334119-632a-4175-9870-cb5591cacbed): created successfully Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d800919-ec6d-491c-8026-dc74ab61c1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Flow 'volume_create_manager' (62d3277d-d83c-4d18-a977-71e5f2123e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:22 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-fd44fbe3-9413-48f2-9f8a-02a8c05a6749 tempest-CreateVolumesFromImageTest-1298396920 None] Created volume successfully. Jul 19 17:51:22 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb99465b-0f3f-4fd6-b640-7ba1f4715759 1073741824" returned: 0 in 0.477s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb99465b-0f3f-4fd6-b640-7ba1f4715759 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:22 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb99465b-0f3f-4fd6-b640-7ba1f4715759 Jul 19 17:51:22 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Flow 'volume_create_manager' (4b4c629b-3d22-4713-80d8-4a4cc6a3688d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b6e3685-5528-45e1-be79-fd0e27c77122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b6e3685-5528-45e1-be79-fd0e27c77122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64762fd-d841-4e11-93a9-d87d246acadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c23c68defc240109c9ada225a58ca5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:23Z,use_quota=True,user_id='4a27f4c8c06b43d2ab7a48f4f38a3bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3f49259-09e5-492d-9a0e-879bca5a89a9),volume_type_id=e3f49259-09e5-492d-9a0e-879bca5a89a9)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131c7251-424f-4de4-a1ad-9abab82dbb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131c7251-424f-4de4-a1ad-9abab82dbb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2fb5f6-efa2-41b4-ac6d-e3d98fc102c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.image.glance [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Creating Keystone auth plugin from conf {{(pid=87676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 17:51:22 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb99465b-0f3f-4fd6-b640-7ba1f4715759" returned: 0 in 0.259s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.089s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557290355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbfd5ed-b10c-4826-9042-2d0844e4f6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e059d676114b799ce92d9545b79b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:20Z,use_quota=True,user_id='b379d3427ced404ca91a667c316f6239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Creating volume 1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:22 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a44b73c-6161-43b3-9728-64f094581101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb99465b-0f3f-4fd6-b640-7ba1f4715759', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:22 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 1073741824 Jul 19 17:51:22 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2222beb6-7d52-4059-b2a1-26f73aa51999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:22 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Volume volume-cb99465b-0f3f-4fd6-b640-7ba1f4715759 (cb99465b-0f3f-4fd6-b640-7ba1f4715759): created successfully Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2222beb6-7d52-4059-b2a1-26f73aa51999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Flow 'volume_create_manager' (09646e37-4f02-40af-b5c8-ed3eace69c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:22 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-3b9c761e-632b-48f6-ab9b-383bf29004f0 tempest-CreateVolumesFromImageTest-1298396920 None] Created volume successfully. Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2fb5f6-efa2-41b4-ac6d-e3d98fc102c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd64762fd-d841-4e11-93a9-d87d246acadb', 'volume_name': 'volume-d64762fd-d841-4e11-93a9-d87d246acadb', 'volume_size': 1, 'image_id': 'e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '150346e8d5498225cbd915160a995b59', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c23c68defc240109c9ada225a58ca5f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6fdee222a713f6b2ae39d6e542d2b31ab027f1b80eecc408d109c6d1afdda6d709f7f30b23156af7eeb08d999c66c12768be236a21f80d9754be2357ae5cee55', 'id': 'e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8', 'created_at': datetime.datetime(2026, 7, 19, 15, 51, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 51, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e4ff08-b5d5-41b9-984b-ec2e4b16a875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e4ff08-b5d5-41b9-984b-ec2e4b16a875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7d4c06-b558-49f3-8e80-384711ef159a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:22 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Volume d64762fd-d841-4e11-93a9-d87d246acadb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d64762fd-d841-4e11-93a9-d87d246acadb', 'volume_size': 1, 'image_id': 'e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '150346e8d5498225cbd915160a995b59', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c23c68defc240109c9ada225a58ca5f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6fdee222a713f6b2ae39d6e542d2b31ab027f1b80eecc408d109c6d1afdda6d709f7f30b23156af7eeb08d999c66c12768be236a21f80d9754be2357ae5cee55', 'id': 'e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8', 'created_at': datetime.datetime(2026, 7, 19, 15, 51, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 51, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 19 17:51:22 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Trying to clone d64762fd-d841-4e11-93a9-d87d246acadb from image e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8', 'metadata': {}}]). {{(pid=87676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 17:51:23 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Image download 0.00 MB at 0.00 MB/s Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1ab640-5c00-4698-8d61-99fe0506fe72]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:23 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD Jul 19 17:51:23 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:23 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 1073741824" returned: 0 in 0.459s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:23 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 Jul 19 17:51:23 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:23 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:23 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD Jul 19 17:51:23 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:23 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5" returned: 0 in 0.275s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.563s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-363515973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1aba09d-3a40-4995-84c5-b62d74ee4a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daaf252d1414e92bf166961c43a6bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:20Z,use_quota=True,user_id='9d6a9c0fa1a74fe7b4cec7f7373bb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Creating volume a1aba09d-3a40-4995-84c5-b62d74ee4a79 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:23 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a1aba09d-3a40-4995-84c5-b62d74ee4a79 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:23 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a1aba09d-3a40-4995-84c5-b62d74ee4a79 1073741824 Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2dbd01-4d5b-4a9f-9438-7e2ad1a56395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:23 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f912ddb3-1759-4453-8f1f-3a7a6b6e867b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:23 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Volume volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 (1dbfd5ed-b10c-4826-9042-2d0844e4f6a5): created successfully Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f912ddb3-1759-4453-8f1f-3a7a6b6e867b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Flow 'volume_create_manager' (84d4bf9f-27b6-4ffd-bd23-2a2806518180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-517d3f17-6f44-4656-ac44-39738f0ddb22 tempest-ProjectReaderTests-1730663272 None] Created volume successfully. Jul 19 17:51:23 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Temporary image e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8 is fetched for user 4a27f4c8c06b43d2ab7a48f4f38a3bb1. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83b6b6e-7434-45cd-9a26-bea594fd4b04]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:23 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD Jul 19 17:51:23 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:24 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a1aba09d-3a40-4995-84c5-b62d74ee4a79 1073741824" returned: 0 in 0.442s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a1aba09d-3a40-4995-84c5-b62d74ee4a79 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:24 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a1aba09d-3a40-4995-84c5-b62d74ee4a79 Jul 19 17:51:24 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:24 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:24 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD Jul 19 17:51:24 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:24 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a1aba09d-3a40-4995-84c5-b62d74ee4a79" returned: 0 in 0.249s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.721s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bad132-263e-44ed-a8de-500751b502f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1aba09d-3a40-4995-84c5-b62d74ee4a79', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db90859-50e5-4248-a5be-07c45d7f9622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Creating offline snapshot d15c60a9-98dc-4f4f-be04-cbe1a7abb288 of volume 9a3742a0-8575-4216-94f0-99de92477597 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:51:24 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Volume volume-a1aba09d-3a40-4995-84c5-b62d74ee4a79 (a1aba09d-3a40-4995-84c5-b62d74ee4a79): created successfully Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db90859-50e5-4248-a5be-07c45d7f9622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Flow 'volume_create_manager' (15ad714b-585f-44f6-bf42-8f1a6245fc42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beab036-1e99-493a-80b7-30e826f8243e]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:24 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-09054e51-3e41-4997-9ba1-cc8cbe3d1219 tempest-CreateVolumesFromImageTest-1298396920 None] Created volume successfully. Jul 19 17:51:24 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597 Jul 19 17:51:24 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:24 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:24 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597" returned: 0 in 0.385s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:24 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288 1G Jul 19 17:51:24 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:25 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288 1G" returned: 0 in 0.387s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3742a0-8575-4216-94f0-99de92477597 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:25 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3742a0-8575-4216-94f0-99de92477597 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288 Jul 19 17:51:25 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:25 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3742a0-8575-4216-94f0-99de92477597 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288" returned: 0 in 0.292s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:25 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288 is being set with open permissions: ugo+rw Jul 19 17:51:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "cinder-a1aba09d-3a40-4995-84c5-b62d74ee4a79-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:25 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288 Jul 19 17:51:25 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-a1aba09d-3a40-4995-84c5-b62d74ee4a79-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "cinder-quobyte-a1aba09d-3a40-4995-84c5-b62d74ee4a79" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-quobyte-a1aba09d-3a40-4995-84c5-b62d74ee4a79" acquired by "delete_volume" :: waited 0.015s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:25 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe778c4b-c7bb-4a40-b5d9-4fd6eefb6836]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a1aba09d-3a40-4995-84c5-b62d74ee4a79 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:25 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a1aba09d-3a40-4995-84c5-b62d74ee4a79 Jul 19 17:51:25 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:25 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288" returned: 0 in 0.264s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:25 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.info Jul 19 17:51:25 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:26 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a1aba09d-3a40-4995-84c5-b62d74ee4a79" returned: 0 in 0.376s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a1aba09d-3a40-4995-84c5-b62d74ee4a79 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:26 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a1aba09d-3a40-4995-84c5-b62d74ee4a79 Jul 19 17:51:26 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:26 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.info" returned: 0 in 0.278s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:26 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.info is being set with open permissions: ugo+rw Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:26 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.info Jul 19 17:51:26 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:26 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-a1aba09d-3a40-4995-84c5-b62d74ee4a79" returned: 0 in 0.268s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-quobyte-a1aba09d-3a40-4995-84c5-b62d74ee4a79" released by "delete_volume" :: held 0.688s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:26 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.info" returned: 0 in 0.258s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.795s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64762fd-d841-4e11-93a9-d87d246acadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c23c68defc240109c9ada225a58ca5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:23Z,use_quota=True,user_id='4a27f4c8c06b43d2ab7a48f4f38a3bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3f49259-09e5-492d-9a0e-879bca5a89a9),volume_type_id=e3f49259-09e5-492d-9a0e-879bca5a89a9)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Creating volume d64762fd-d841-4e11-93a9-d87d246acadb {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:26 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:26 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb 1073741824 Jul 19 17:51:26 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Created reservations ['4f71ec98-017b-4769-9fd5-431eea21aaca', '370e7efb-8d90-4776-8a5e-519fb685c835', 'a46a157b-c749-4d53-a711-bac3fd27e2ec', '98ba3040-7fc4-46ba-ab5b-a583de11c302'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:26 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-3d6d1a8b-379f-4433-a6ce-9ca466dc01cc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Create snapshot completed successfully Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:26 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:26 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "cinder-cb99465b-0f3f-4fd6-b640-7ba1f4715759-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:26 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.263s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-cb99465b-0f3f-4fd6-b640-7ba1f4715759-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:26 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Deleted volume successfully. Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-574b998e-1039-4e70-b506-623fa93c6161 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-a1aba09d-3a40-4995-84c5-b62d74ee4a79-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "cinder-quobyte-cb99465b-0f3f-4fd6-b640-7ba1f4715759" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-quobyte-cb99465b-0f3f-4fd6-b640-7ba1f4715759" acquired by "delete_volume" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1fcc2c-011a-4b78-87b9-83a9e6872b56]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb99465b-0f3f-4fd6-b640-7ba1f4715759 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:26 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb 1073741824" returned: 0 in 0.524s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:26 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb99465b-0f3f-4fd6-b640-7ba1f4715759 Jul 19 17:51:26 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:26 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb Jul 19 17:51:26 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:27 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb" returned: 0 in 0.274s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.303s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] Creating offline snapshot daa37d9b-2f86-492d-85a7-95ee49fe135f of volume 1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Attempting download of e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8 ((None, [{'url': 'file:///opt/stack/data/glance/images/e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8', 'metadata': {}}])) to volume d64762fd-d841-4e11-93a9-d87d246acadb. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 17:51:27 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7f26ad-a72c-4671-bde8-794a2d75e713]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb99465b-0f3f-4fd6-b640-7ba1f4715759" returned: 0 in 0.445s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb99465b-0f3f-4fd6-b640-7ba1f4715759 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:27 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb99465b-0f3f-4fd6-b640-7ba1f4715759 Jul 19 17:51:27 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6211c9-46f7-4e3d-bf3e-f2a52c7c11d3]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8___66zaq1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:27 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 Jul 19 17:51:27 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Flow 'volume_create_manager' (673be34e-49fd-4f9c-8278-006fbf5d5513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675b9e30-fc89-437c-9097-c0dae1d67a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675b9e30-fc89-437c-9097-c0dae1d67a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-145719361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111cb3dc-0bbd-44ca-9ebe-f6e243c92851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b016c8d9694276b4d6474a90ab94fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:27Z,use_quota=True,user_id='557e1d82e4fd4dd580e034eb61cce346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:27 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8___66zaq1 Jul 19 17:51:27 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b25537-bbfd-4562-b882-013724b20303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b25537-bbfd-4562-b882-013724b20303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c05fa1-039f-4e51-a520-f4023110ad99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c05fa1-039f-4e51-a520-f4023110ad99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '111cb3dc-0bbd-44ca-9ebe-f6e243c92851', 'volume_name': 'volume-111cb3dc-0bbd-44ca-9ebe-f6e243c92851', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32abb6d-09f8-42cd-a66f-c200dfe53d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32abb6d-09f8-42cd-a66f-c200dfe53d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae941e6f-fe20-420d-ba10-86b6c6ea4b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:27 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume 111cb3dc-0bbd-44ca-9ebe-f6e243c92851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-111cb3dc-0bbd-44ca-9ebe-f6e243c92851', 'volume_size': 1} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:27 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb99465b-0f3f-4fd6-b640-7ba1f4715759" returned: 0 in 0.446s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-quobyte-cb99465b-0f3f-4fd6-b640-7ba1f4715759" released by "delete_volume" :: held 0.947s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:27 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5" returned: 0 in 0.512s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:27 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f 1G Jul 19 17:51:27 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:27 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8___66zaq1" returned: 0 in 0.556s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8___66zaq1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:27 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Flow 'volume_create_manager' (265be360-b47f-41ad-a3fa-416c10af0c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7925879a-eadb-4058-a24f-075e3159b64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Created reservations ['d5478981-18f3-48d4-8077-1c85636828d4', 'c85261cd-9e04-49fc-b8c0-0203b0688d9c', '8eeedd75-1f08-4ece-94f4-7f089de94a99', 'a5e3a1f3-96c3-444e-a1b4-23d698dc94c0'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7925879a-eadb-4058-a24f-075e3159b64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1283277570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249d7760-b724-439b-b7ac-b62f48832464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b016c8d9694276b4d6474a90ab94fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:28Z,use_quota=True,user_id='557e1d82e4fd4dd580e034eb61cce346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9a8047-9d36-49da-b8c0-c3b91a3c5919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9a8047-9d36-49da-b8c0-c3b91a3c5919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01bd8129-2650-40a4-a83b-1b6194eda634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01bd8129-2650-40a4-a83b-1b6194eda634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '249d7760-b724-439b-b7ac-b62f48832464', 'volume_name': 'volume-249d7760-b724-439b-b7ac-b62f48832464', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de162cec-93d3-4418-a909-db99bb66e6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de162cec-93d3-4418-a909-db99bb66e6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1aa2d87-b432-40ac-bc45-94394c85b25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:28 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume 249d7760-b724-439b-b7ac-b62f48832464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-249d7760-b724-439b-b7ac-b62f48832464', 'volume_size': 1} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:28 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8___66zaq1 Jul 19 17:51:28 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:28 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:28 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:28 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Flow 'volume_create_manager' (9177a3f9-6299-4a5e-adec-9d5dc83c944a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3dd04ea-db54-4c08-98e1-a48aedd57c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8___66zaq1" returned: 1 in 0.544s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8___66zaq1' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6ee7dc-e50f-4e7b-a497-4f251dc0cb7b]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:28 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f 1G" returned: 0 in 0.737s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3dd04ea-db54-4c08-98e1-a48aedd57c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-690545316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670ea30a-1abd-4559-93dd-818beaea0825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b016c8d9694276b4d6474a90ab94fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:28Z,use_quota=True,user_id='557e1d82e4fd4dd580e034eb61cce346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2511d1da-4b9b-4326-92f4-48a60a9f15ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2511d1da-4b9b-4326-92f4-48a60a9f15ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c275e3-2c34-47e3-9b3d-f5b0d7043dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:28 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c275e3-2c34-47e3-9b3d-f5b0d7043dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '670ea30a-1abd-4559-93dd-818beaea0825', 'volume_name': 'volume-670ea30a-1abd-4559-93dd-818beaea0825', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef67fd9f-8473-4d17-843b-d0ba74fecc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef67fd9f-8473-4d17-843b-d0ba74fecc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77410a94-75b2-4f90-9b52-5094246f464c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:28 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume 670ea30a-1abd-4559-93dd-818beaea0825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-670ea30a-1abd-4559-93dd-818beaea0825', 'volume_size': 1} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.386s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:28 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Deleted volume successfully. Jul 19 17:51:28 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD Jul 19 17:51:28 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:28 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f Jul 19 17:51:28 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-129ad21c-24a6-480f-beb3-b2aa1276988d tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-cb99465b-0f3f-4fd6-b640-7ba1f4715759-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:28 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:28 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f" returned: 0 in 0.384s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:28 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f is being set with open permissions: ugo+rw Jul 19 17:51:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:29 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f Jul 19 17:51:29 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:29 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD Jul 19 17:51:29 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Flow 'volume_create_manager' (11802f47-84e6-4f08-81d7-c5f304115613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6063c8-ae03-41a5-b92a-77a5e1561c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6063c8-ae03-41a5-b92a-77a5e1561c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-521234749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83435597-8d4c-4d00-bcff-a3bed055121e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b016c8d9694276b4d6474a90ab94fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:29Z,use_quota=True,user_id='557e1d82e4fd4dd580e034eb61cce346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe3fdf5-3446-49b8-a7f4-05c4c24bac4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe3fdf5-3446-49b8-a7f4-05c4c24bac4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0474bba7-272a-4eea-ade6-6c47a71858eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0474bba7-272a-4eea-ade6-6c47a71858eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83435597-8d4c-4d00-bcff-a3bed055121e', 'volume_name': 'volume-83435597-8d4c-4d00-bcff-a3bed055121e', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b016ac4d-9af7-4ac5-b539-e4b6b43adff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b016ac4d-9af7-4ac5-b539-e4b6b43adff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab2f666-591c-41ad-a909-4449f7da2f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:29 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume 83435597-8d4c-4d00-bcff-a3bed055121e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83435597-8d4c-4d00-bcff-a3bed055121e', 'volume_size': 1} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "cinder-7a334119-632a-4175-9870-cb5591cacbed-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-7a334119-632a-4175-9870-cb5591cacbed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "cinder-quobyte-7a334119-632a-4175-9870-cb5591cacbed" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-quobyte-7a334119-632a-4175-9870-cb5591cacbed" acquired by "delete_volume" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4900024-095e-4c57-92ab-219dc12b1182]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7a334119-632a-4175-9870-cb5591cacbed {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:29 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD" returned: 1 in 0.480s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8 was raw, converting to qcow2 {{(pid=87676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:29 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb Jul 19 17:51:29 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:29 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f" returned: 0 in 0.446s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:29 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7a334119-632a-4175-9870-cb5591cacbed Jul 19 17:51:29 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Flow 'volume_create_manager' (546c6ff5-59db-4fb2-b5c9-057f62c80c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4827aa16-f531-4283-acaa-ffac2fbe0488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4827aa16-f531-4283-acaa-ffac2fbe0488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-605041320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedb969a-34a2-4b23-ae69-70916ff1cbb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b016c8d9694276b4d6474a90ab94fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:29Z,use_quota=True,user_id='557e1d82e4fd4dd580e034eb61cce346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc216066-c9c1-4357-be5a-0700c19d78cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc216066-c9c1-4357-be5a-0700c19d78cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b106eba-f5c1-4403-8696-01a0db178b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b106eba-f5c1-4403-8696-01a0db178b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eedb969a-34a2-4b23-ae69-70916ff1cbb1', 'volume_name': 'volume-eedb969a-34a2-4b23-ae69-70916ff1cbb1', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361dcf98-7836-4102-b163-0fc606f01f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361dcf98-7836-4102-b163-0fc606f01f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0589f14c-89a1-4d08-816b-edf727145593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:29 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume eedb969a-34a2-4b23-ae69-70916ff1cbb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eedb969a-34a2-4b23-ae69-70916ff1cbb1', 'volume_size': 1} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:29 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.info Jul 19 17:51:29 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:29 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7a334119-632a-4175-9870-cb5591cacbed" returned: 0 in 0.429s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7a334119-632a-4175-9870-cb5591cacbed {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:29 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7a334119-632a-4175-9870-cb5591cacbed Jul 19 17:51:29 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:29 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb" returned: 0 in 0.468s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8_rs9jhgfvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:51:29 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Converted 0.00 MB image at 0.00 MB/s Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:29 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.info" returned: 0 in 0.286s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:29 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.info is being set with open permissions: ugo+rw Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:29 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb 1G Jul 19 17:51:29 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:29 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.info Jul 19 17:51:29 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:29 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-7a334119-632a-4175-9870-cb5591cacbed" returned: 0 in 0.278s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-quobyte-7a334119-632a-4175-9870-cb5591cacbed" released by "delete_volume" :: held 0.775s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Created reservations ['4460c96d-f922-4616-b197-11abe0221dbb', '416767a0-eb08-4c5d-90ff-be6265513e42', 'bafe951f-60e9-4969-af44-09255b52d42a', 'fbeb4956-3d6e-4d73-95cf-3d9282335df7'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:30 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.info" returned: 0 in 0.270s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.894s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.474s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-145719361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111cb3dc-0bbd-44ca-9ebe-f6e243c92851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b016c8d9694276b4d6474a90ab94fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:27Z,use_quota=True,user_id='557e1d82e4fd4dd580e034eb61cce346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Creating volume 111cb3dc-0bbd-44ca-9ebe-f6e243c92851 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:30 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-111cb3dc-0bbd-44ca-9ebe-f6e243c92851 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:30 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-111cb3dc-0bbd-44ca-9ebe-f6e243c92851 1073741824 Jul 19 17:51:30 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:30 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb 1G" returned: 0 in 0.358s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Downloaded image e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8 ((None, [{'url': 'file:///opt/stack/data/glance/images/e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8', 'metadata': {}}])) to volume d64762fd-d841-4e11-93a9-d87d246acadb successfully. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Temporary image e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8 for user 4a27f4c8c06b43d2ab7a48f4f38a3bb1 is deleted. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Marking volume d64762fd-d841-4e11-93a9-d87d246acadb as bootable. {{(pid=87676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 17:51:30 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-50cb2e2f-cc26-404a-b12a-5d62a3f00cb2 tempest-ProjectReaderTests-1730663272 None] Create snapshot completed successfully Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Copying metadata from image e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8 to d64762fd-d841-4e11-93a9-d87d246acadb. {{(pid=87676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Creating volume glance metadata for volume d64762fd-d841-4e11-93a9-d87d246acadb backed by image e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '150346e8d5498225cbd915160a995b59', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:30 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:30 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7d4c06-b558-49f3-8e80-384711ef159a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64762fd-d841-4e11-93a9-d87d246acadb', 'volume_size': 1, 'image_id': 'e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '150346e8d5498225cbd915160a995b59', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c23c68defc240109c9ada225a58ca5f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6fdee222a713f6b2ae39d6e542d2b31ab027f1b80eecc408d109c6d1afdda6d709f7f30b23156af7eeb08d999c66c12768be236a21f80d9754be2357ae5cee55', 'id': 'e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8', 'created_at': datetime.datetime(2026, 7, 19, 15, 51, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 51, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e6b7ab34-f8d4-4e51-aa5e-eccf90a59af8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d59e74f-bcd4-42f3-be0c-699c99512582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:30 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Volume volume-d64762fd-d841-4e11-93a9-d87d246acadb (d64762fd-d841-4e11-93a9-d87d246acadb): created successfully Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d59e74f-bcd4-42f3-be0c-699c99512582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Flow 'volume_create_manager' (4b4c629b-3d22-4713-80d8-4a4cc6a3688d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "cinder-658db194-0783-4476-b59b-9efb2d6ae0c7-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:30 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-7a10fbb3-cd1b-4104-a450-5e82f60b5a20 tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Created volume successfully. Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-658db194-0783-4476-b59b-9efb2d6ae0c7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "cinder-quobyte-658db194-0783-4476-b59b-9efb2d6ae0c7" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-quobyte-658db194-0783-4476-b59b-9efb2d6ae0c7" acquired by "delete_volume" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4148cb66-9602-4da0-9007-0e465e7f580f]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-658db194-0783-4476-b59b-9efb2d6ae0c7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:30 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.311s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:30 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Deleted volume successfully. Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9522ac8b-c729-4b73-b872-51c748c98f53 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-7a334119-632a-4175-9870-cb5591cacbed-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:30 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-658db194-0783-4476-b59b-9efb2d6ae0c7 Jul 19 17:51:30 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-daa37d9b-2f86-492d-85a7-95ee49fe135f-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-daa37d9b-2f86-492d-85a7-95ee49fe135f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-quobyte-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-quobyte-daa37d9b-2f86-492d-85a7-95ee49fe135f" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Acquiring lock "cinder-d64762fd-d841-4e11-93a9-d87d246acadb-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Lock "cinder-d64762fd-d841-4e11-93a9-d87d246acadb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-daa37d9b-2f86-492d-85a7-95ee49fe135f" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Deleting offline snapshot daa37d9b-2f86-492d-85a7-95ee49fe135f of volume 1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] snapshot_file for this snap is: volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fe9fd0-42b3-4c0c-982e-d333caef6edd]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:30 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-111cb3dc-0bbd-44ca-9ebe-f6e243c92851 1073741824" returned: 0 in 0.737s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Acquiring lock "cinder-quobyte-d64762fd-d841-4e11-93a9-d87d246acadb" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Lock "cinder-quobyte-d64762fd-d841-4e11-93a9-d87d246acadb" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-111cb3dc-0bbd-44ca-9ebe-f6e243c92851 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[637b21a4-feb7-48d1-b2c3-158dd6381287]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:30 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:30 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-111cb3dc-0bbd-44ca-9ebe-f6e243c92851 Jul 19 17:51:30 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:30 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f Jul 19 17:51:30 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-658db194-0783-4476-b59b-9efb2d6ae0c7" returned: 0 in 0.473s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-658db194-0783-4476-b59b-9efb2d6ae0c7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:31 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-658db194-0783-4476-b59b-9efb2d6ae0c7 Jul 19 17:51:31 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:31 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb Jul 19 17:51:31 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:31 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f" returned: 0 in 0.442s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:51:31 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-111cb3dc-0bbd-44ca-9ebe-f6e243c92851" returned: 0 in 0.383s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.219s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1283277570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249d7760-b724-439b-b7ac-b62f48832464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b016c8d9694276b4d6474a90ab94fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:28Z,use_quota=True,user_id='557e1d82e4fd4dd580e034eb61cce346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Creating volume 249d7760-b724-439b-b7ac-b62f48832464 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:31 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-249d7760-b724-439b-b7ac-b62f48832464 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:31 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc729ee-800d-48e4-9075-1c42c8eb6ea0]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:31 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-249d7760-b724-439b-b7ac-b62f48832464 1073741824 Jul 19 17:51:31 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-658db194-0783-4476-b59b-9efb2d6ae0c7" returned: 0 in 0.392s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae941e6f-fe20-420d-ba10-86b6c6ea4b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-111cb3dc-0bbd-44ca-9ebe-f6e243c92851', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:31 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300e6006-2bb9-420e-8326-f97152d211a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb" returned: 0 in 0.456s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-quobyte-658db194-0783-4476-b59b-9efb2d6ae0c7" released by "delete_volume" :: held 0.958s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:31 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume volume-111cb3dc-0bbd-44ca-9ebe-f6e243c92851 (111cb3dc-0bbd-44ca-9ebe-f6e243c92851): created successfully Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300e6006-2bb9-420e-8326-f97152d211a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Flow 'volume_create_manager' (673be34e-49fd-4f9c-8278-006fbf5d5513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:31 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb Jul 19 17:51:31 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:31 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-3ee66c25-eb27-4d46-b6dc-bbdd6df71187 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Created volume successfully. Jul 19 17:51:31 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 Jul 19 17:51:31 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Created reservations ['9d270cba-bf51-4d37-a368-2bfe579e4a9c', '2bd54cc0-ff8f-4e68-b5f3-b61a5118085b', 'f7217d16-cb0e-4a5f-8425-ca643ac9b7d2', '6542224b-4fdd-422f-bbb0-a150c837c794'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:31 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:31 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:31 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d64762fd-d841-4e11-93a9-d87d246acadb" returned: 0 in 0.359s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Lock "cinder-quobyte-d64762fd-d841-4e11-93a9-d87d246acadb" released by "delete_volume" :: held 0.873s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:31 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5" returned: 0 in 0.479s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Created reservations ['f9b2853e-f98b-4288-869c-593882984ded', '6d69d5ef-b305-4ca2-9617-7eb59d333992', '7517ec15-dc33-4554-90da-43514afd341f', '6805dcdc-2095-4faf-a43f-85f15a86f406'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:31 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f Jul 19 17:51:31 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:31 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.346s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:31 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:31 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-249d7760-b724-439b-b7ac-b62f48832464 1073741824" returned: 0 in 0.665s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:32 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:32 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Deleted volume successfully. Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8d9f342f-33e8-4b91-b9ca-6c44a1871ad3 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-658db194-0783-4476-b59b-9efb2d6ae0c7-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-249d7760-b724-439b-b7ac-b62f48832464 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:32 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-249d7760-b724-439b-b7ac-b62f48832464 Jul 19 17:51:32 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:32 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.287s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Deleted volume successfully. Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-246c0ac6-9956-4b21-88f5-13259a09dc5c tempest-VolumeAndVolumeTypeFromImageTest-511231022 None] Lock "cinder-d64762fd-d841-4e11-93a9-d87d246acadb-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:32 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f" returned: 0 in 0.508s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:32 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f Jul 19 17:51:32 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:32 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-249d7760-b724-439b-b7ac-b62f48832464" returned: 0 in 0.318s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.810s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-690545316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670ea30a-1abd-4559-93dd-818beaea0825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b016c8d9694276b4d6474a90ab94fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:28Z,use_quota=True,user_id='557e1d82e4fd4dd580e034eb61cce346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Creating volume 670ea30a-1abd-4559-93dd-818beaea0825 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:32 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-670ea30a-1abd-4559-93dd-818beaea0825 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1aa2d87-b432-40ac-bc45-94394c85b25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-249d7760-b724-439b-b7ac-b62f48832464', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:32 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-670ea30a-1abd-4559-93dd-818beaea0825 1073741824 Jul 19 17:51:32 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85907ad3-4cfd-4c3d-b0c9-8e5b85008497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:32 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume volume-249d7760-b724-439b-b7ac-b62f48832464 (249d7760-b724-439b-b7ac-b62f48832464): created successfully Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85907ad3-4cfd-4c3d-b0c9-8e5b85008497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Flow 'volume_create_manager' (265be360-b47f-41ad-a3fa-416c10af0c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-4088be76-ae7c-4a77-a722-a320393fd1dc tempest-CreateVolumesFromSnapshotTest-1420105982 None] Created volume successfully. Jul 19 17:51:32 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5.daa37d9b-2f86-492d-85a7-95ee49fe135f" returned: 0 in 0.271s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-daa37d9b-2f86-492d-85a7-95ee49fe135f" released by "_delete_snapshot" :: held 1.857s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5" released by "delete_snapshot" :: held 1.910s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "cinder-02db690f-efe3-4a50-858d-4df2b7a66e2e-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-02db690f-efe3-4a50-858d-4df2b7a66e2e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "cinder-quobyte-02db690f-efe3-4a50-858d-4df2b7a66e2e" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Created reservations ['ee3dd23d-ad36-4636-8a51-0320511866f6', 'fa84116a-6b58-48e4-80d6-fdd9206e3e6d', 'fc2370b4-a99e-4af1-93c4-fe926d327cf8', '71f2f70d-67a6-4209-ad4c-1a01d188e5eb'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-quobyte-02db690f-efe3-4a50-858d-4df2b7a66e2e" acquired by "delete_volume" :: waited 0.039s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9002f818-8512-4062-9c54-4dc80b5beea8]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-02db690f-efe3-4a50-858d-4df2b7a66e2e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:32 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-670ea30a-1abd-4559-93dd-818beaea0825 1073741824" returned: 0 in 0.544s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Delete snapshot completed successfully. Jul 19 17:51:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff44c5c3-b1e5-4a16-9477-f509fdbe89f4 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-daa37d9b-2f86-492d-85a7-95ee49fe135f-delete_snapshot" released by "delete_snapshot" :: held 2.245s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-670ea30a-1abd-4559-93dd-818beaea0825 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:33 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-02db690f-efe3-4a50-858d-4df2b7a66e2e Jul 19 17:51:33 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:33 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-670ea30a-1abd-4559-93dd-818beaea0825 Jul 19 17:51:33 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:33 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-670ea30a-1abd-4559-93dd-818beaea0825" returned: 0 in 0.261s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.142s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-521234749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83435597-8d4c-4d00-bcff-a3bed055121e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b016c8d9694276b4d6474a90ab94fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:29Z,use_quota=True,user_id='557e1d82e4fd4dd580e034eb61cce346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Creating volume 83435597-8d4c-4d00-bcff-a3bed055121e {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:33 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-83435597-8d4c-4d00-bcff-a3bed055121e 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:33 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-83435597-8d4c-4d00-bcff-a3bed055121e 1073741824 Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77410a94-75b2-4f90-9b52-5094246f464c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-670ea30a-1abd-4559-93dd-818beaea0825', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0baf598a-e047-4310-900b-fb77ffb5269a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:33 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:33 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-02db690f-efe3-4a50-858d-4df2b7a66e2e" returned: 0 in 0.430s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-02db690f-efe3-4a50-858d-4df2b7a66e2e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:33 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-02db690f-efe3-4a50-858d-4df2b7a66e2e Jul 19 17:51:33 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume volume-670ea30a-1abd-4559-93dd-818beaea0825 (670ea30a-1abd-4559-93dd-818beaea0825): created successfully Jul 19 17:51:33 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0baf598a-e047-4310-900b-fb77ffb5269a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Flow 'volume_create_manager' (9177a3f9-6299-4a5e-adec-9d5dc83c944a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:33 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-dccdb8ac-120a-467a-a56d-c60a395e62b4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Created volume successfully. Jul 19 17:51:33 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-02db690f-efe3-4a50-858d-4df2b7a66e2e" returned: 0 in 0.293s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-quobyte-02db690f-efe3-4a50-858d-4df2b7a66e2e" released by "delete_volume" :: held 0.776s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Created reservations ['2ecb9264-2f28-48a9-bee4-629b0c6f9eed', '79650ce8-4436-4206-94d8-5ca620cee0b7', '1ce50691-8e28-4035-bc65-11b36a90cfe9', '88635a78-b76a-4b41-b32e-958c57f519fa'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:33 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-83435597-8d4c-4d00-bcff-a3bed055121e 1073741824" returned: 0 in 0.505s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:33 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:33 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-83435597-8d4c-4d00-bcff-a3bed055121e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:33 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-83435597-8d4c-4d00-bcff-a3bed055121e Jul 19 17:51:33 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-quobyte-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:34 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:34 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-83435597-8d4c-4d00-bcff-a3bed055121e" returned: 0 in 0.453s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.508s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.761s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-605041320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedb969a-34a2-4b23-ae69-70916ff1cbb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b016c8d9694276b4d6474a90ab94fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:29Z,use_quota=True,user_id='557e1d82e4fd4dd580e034eb61cce346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Creating volume eedb969a-34a2-4b23-ae69-70916ff1cbb1 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:34 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eedb969a-34a2-4b23-ae69-70916ff1cbb1 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a04fc89-a193-47fa-b780-3962110597e1]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:34 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eedb969a-34a2-4b23-ae69-70916ff1cbb1 1073741824 Jul 19 17:51:34 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:34 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Deleted volume successfully. Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab2f666-591c-41ad-a909-4449f7da2f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83435597-8d4c-4d00-bcff-a3bed055121e', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f77601-3f09-4e82-8915-711e59dc59ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:34 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume volume-83435597-8d4c-4d00-bcff-a3bed055121e (83435597-8d4c-4d00-bcff-a3bed055121e): created successfully Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f77601-3f09-4e82-8915-711e59dc59ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Flow 'volume_create_manager' (11802f47-84e6-4f08-81d7-c5f304115613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-806105c2-07d2-473a-83b2-c70cd7cd8d23 tempest-CreateVolumesFromImageTest-1298396920 None] Lock "cinder-02db690f-efe3-4a50-858d-4df2b7a66e2e-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:34 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-4919e8fc-2da3-4a4b-a758-23d08d6d138f tempest-CreateVolumesFromSnapshotTest-1420105982 None] Created volume successfully. Jul 19 17:51:34 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 Jul 19 17:51:34 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:34 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eedb969a-34a2-4b23-ae69-70916ff1cbb1 1073741824" returned: 0 in 0.625s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:34 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5" returned: 0 in 0.619s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:34 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5 Jul 19 17:51:34 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eedb969a-34a2-4b23-ae69-70916ff1cbb1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:35 devstack sudo[103971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:35 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:35 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eedb969a-34a2-4b23-ae69-70916ff1cbb1 Jul 19 17:51:35 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:35 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.334s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 29 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:51:35 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5" returned: 0 in 0.441s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5" released by "delete_volume" :: held 1.189s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:35 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eedb969a-34a2-4b23-ae69-70916ff1cbb1" returned: 0 in 0.428s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0589f14c-89a1-4d08-816b-edf727145593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eedb969a-34a2-4b23-ae69-70916ff1cbb1', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8c4063-daf6-442c-a319-285f1af45814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:35 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Volume volume-eedb969a-34a2-4b23-ae69-70916ff1cbb1 (eedb969a-34a2-4b23-ae69-70916ff1cbb1): created successfully Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8c4063-daf6-442c-a319-285f1af45814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Flow 'volume_create_manager' (546c6ff5-59db-4fb2-b5c9-057f62c80c3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Created reservations ['b5948786-5503-4f68-b305-3bdce88b8d60', '1dffed25-ce21-4b8e-8f66-1d2b5e9811c8', 'dc1228ec-0334-43d4-845b-b9292f6ee070', '5e53a8a3-5ca9-4384-ad56-7f2053e9536e'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:35 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-34dc8594-da04-406b-9128-413cf6328cc4 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Created volume successfully. Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:35 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:35 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:35 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.276s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:35 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Deleted volume successfully. Jul 19 17:51:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ba5b6965-a777-49eb-9715-6e188451fe35 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-1dbfd5ed-b10c-4826-9042-2d0844e4f6a5-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "cinder-eedb969a-34a2-4b23-ae69-70916ff1cbb1-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-eedb969a-34a2-4b23-ae69-70916ff1cbb1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "cinder-quobyte-eedb969a-34a2-4b23-ae69-70916ff1cbb1" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-quobyte-eedb969a-34a2-4b23-ae69-70916ff1cbb1" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:36 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e705e211-4db8-4784-b557-df94c5e8020d]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eedb969a-34a2-4b23-ae69-70916ff1cbb1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:36 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eedb969a-34a2-4b23-ae69-70916ff1cbb1 Jul 19 17:51:36 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:37 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Flow 'volume_create_manager' (4735eb8c-133a-46cc-8288-949bc46eac58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8b5b94-e5aa-44c3-b754-c69f3c9f9793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eedb969a-34a2-4b23-ae69-70916ff1cbb1" returned: 0 in 0.493s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eedb969a-34a2-4b23-ae69-70916ff1cbb1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:37 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eedb969a-34a2-4b23-ae69-70916ff1cbb1 Jul 19 17:51:37 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8b5b94-e5aa-44c3-b754-c69f3c9f9793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-75535682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dbda929-b701-4c4b-9a0a-620b86d4aad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e059d676114b799ce92d9545b79b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:37Z,use_quota=True,user_id='b379d3427ced404ca91a667c316f6239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce7382a-0d95-4dde-9ca4-3cd9f08e93b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce7382a-0d95-4dde-9ca4-3cd9f08e93b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ff81a4-9a4b-49bc-9c88-8b1da9519692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ff81a4-9a4b-49bc-9c88-8b1da9519692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dbda929-b701-4c4b-9a0a-620b86d4aad7', 'volume_name': 'volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a827ca-eed2-4c7e-ac2d-5e8e31900265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a827ca-eed2-4c7e-ac2d-5e8e31900265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f237bcf-9975-4617-9fa0-b1f6c94fd2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:37 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Volume 8dbda929-b701-4c4b-9a0a-620b86d4aad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7', 'volume_size': 1} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-75535682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dbda929-b701-4c4b-9a0a-620b86d4aad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e059d676114b799ce92d9545b79b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:37Z,use_quota=True,user_id='b379d3427ced404ca91a667c316f6239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Creating volume 8dbda929-b701-4c4b-9a0a-620b86d4aad7 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:37 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:37 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 1073741824 Jul 19 17:51:37 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:37 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-eedb969a-34a2-4b23-ae69-70916ff1cbb1" returned: 0 in 0.269s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-quobyte-eedb969a-34a2-4b23-ae69-70916ff1cbb1" released by "delete_volume" :: held 0.813s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Created reservations ['a49e655b-e97a-4805-8148-9c146c766b8b', 'b4e88936-c444-47e9-be26-5ae17ca64b69', '9f829b00-a519-4e0e-927e-5dbfe11c8dea', '04753653-a3af-47ef-bcb4-52192699e02c'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:37 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:37 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "cinder-83435597-8d4c-4d00-bcff-a3bed055121e-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:37 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-83435597-8d4c-4d00-bcff-a3bed055121e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 1073741824" returned: 0 in 0.615s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:37 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "cinder-quobyte-83435597-8d4c-4d00-bcff-a3bed055121e" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.315s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:37 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Deleted volume successfully. Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-quobyte-83435597-8d4c-4d00-bcff-a3bed055121e" acquired by "delete_volume" :: waited 0.033s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:37 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 Jul 19 17:51:37 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-80f4535b-6ada-4f34-87c5-604bed1fa082 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-eedb969a-34a2-4b23-ae69-70916ff1cbb1-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a69e1b-c4f9-4aff-8b28-29dbc12fc180]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-83435597-8d4c-4d00-bcff-a3bed055121e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Flow 'volume_create_manager' (6eca8342-a3f0-4fd1-9059-cd6fc2714b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5b103c-2e16-407b-ac03-23b2c0d0dbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5b103c-2e16-407b-ac03-23b2c0d0dbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8299c321-fe99-44e6-9dec-e7087582fff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3e1e33fbb24193b726d8bab8a83e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:38Z,use_quota=True,user_id='e48509fc31884d35a4f711e6b008270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:38 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-83435597-8d4c-4d00-bcff-a3bed055121e Jul 19 17:51:38 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dceaf7-bf55-444d-bbbc-10039effa8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dceaf7-bf55-444d-bbbc-10039effa8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3df8be9-75e5-4a00-bb6a-f1afcf3db6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3df8be9-75e5-4a00-bb6a-f1afcf3db6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8299c321-fe99-44e6-9dec-e7087582fff9', 'volume_name': 'volume-8299c321-fe99-44e6-9dec-e7087582fff9', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c53aa57-00aa-4ee8-b9a0-da49b8e698ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c53aa57-00aa-4ee8-b9a0-da49b8e698ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe66abe-5ec3-47e6-9345-b5a15ac2d0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:38 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Volume 8299c321-fe99-44e6-9dec-e7087582fff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8299c321-fe99-44e6-9dec-e7087582fff9', 'volume_size': 1} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:38 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7" returned: 0 in 0.332s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.017s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8299c321-fe99-44e6-9dec-e7087582fff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3e1e33fbb24193b726d8bab8a83e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:38Z,use_quota=True,user_id='e48509fc31884d35a4f711e6b008270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Creating volume 8299c321-fe99-44e6-9dec-e7087582fff9 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:38 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8299c321-fe99-44e6-9dec-e7087582fff9 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:38 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8299c321-fe99-44e6-9dec-e7087582fff9 1073741824 Jul 19 17:51:38 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f237bcf-9975-4617-9fa0-b1f6c94fd2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6ae715-9600-493d-9ed1-b03ddd3d9f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Flow 'volume_create_manager' (4dc992c5-f82c-4e28-8582-e5400f0d6c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31faa7d7-4fbf-409f-b8a5-b6f95dcd7f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31faa7d7-4fbf-409f-b8a5-b6f95dcd7f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-54198298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48680553be434e57a38cf3cc0b12f5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:38Z,use_quota=True,user_id='2a1ac627ceb14ee98a8ddaf5fa6c4196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1909b7-bf7d-451c-844b-f9063281528d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1909b7-bf7d-451c-844b-f9063281528d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b7ffdd-ea7b-4dd6-af64-ffc1157b92fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b7ffdd-ea7b-4dd6-af64-ffc1157b92fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1', 'volume_name': 'volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c6f016-02ea-4404-b120-ba10e38d99ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c6f016-02ea-4404-b120-ba10e38d99ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e949930-8478-431d-b631-9db34c4184a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:38 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Volume ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1', 'volume_size': 1} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:38 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Volume volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 (8dbda929-b701-4c4b-9a0a-620b86d4aad7): created successfully Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6ae715-9600-493d-9ed1-b03ddd3d9f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Flow 'volume_create_manager' (4735eb8c-133a-46cc-8288-949bc46eac58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:38 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-83a492c1-32fa-4c50-bb55-f80a80021d31 tempest-ProjectReaderTests-1730663272 None] Created volume successfully. Jul 19 17:51:38 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-83435597-8d4c-4d00-bcff-a3bed055121e" returned: 0 in 0.451s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-83435597-8d4c-4d00-bcff-a3bed055121e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:38 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-83435597-8d4c-4d00-bcff-a3bed055121e Jul 19 17:51:38 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:38 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-83435597-8d4c-4d00-bcff-a3bed055121e" returned: 0 in 0.250s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:38 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8299c321-fe99-44e6-9dec-e7087582fff9 1073741824" returned: 0 in 0.440s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-quobyte-83435597-8d4c-4d00-bcff-a3bed055121e" released by "delete_volume" :: held 0.784s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8299c321-fe99-44e6-9dec-e7087582fff9 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:38 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8299c321-fe99-44e6-9dec-e7087582fff9 Jul 19 17:51:38 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Created reservations ['bb1ff70d-23af-4ecf-b2fa-a8e9004a572e', 'b9eda4cc-cb8f-44d6-8ea8-983b4ab3675b', 'b7a2c94b-ec23-4607-b3a5-0fde54437602', 'c8ec5c75-bfa5-4f6b-ba0f-9d09674f0e85'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:38 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:38 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "cinder-670ea30a-1abd-4559-93dd-818beaea0825-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-670ea30a-1abd-4559-93dd-818beaea0825-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:39 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8299c321-fe99-44e6-9dec-e7087582fff9" returned: 0 in 0.303s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.662s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-54198298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48680553be434e57a38cf3cc0b12f5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:38Z,use_quota=True,user_id='2a1ac627ceb14ee98a8ddaf5fa6c4196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Creating volume ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:39 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "cinder-quobyte-670ea30a-1abd-4559-93dd-818beaea0825" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:39 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 1073741824 Jul 19 17:51:39 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe66abe-5ec3-47e6-9345-b5a15ac2d0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8299c321-fe99-44e6-9dec-e7087582fff9', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fffdbb1-8098-4055-8a16-dfee26dc0d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-quobyte-670ea30a-1abd-4559-93dd-818beaea0825" acquired by "delete_volume" :: waited 0.037s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:39 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Volume volume-8299c321-fe99-44e6-9dec-e7087582fff9 (8299c321-fe99-44e6-9dec-e7087582fff9): created successfully Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fffdbb1-8098-4055-8a16-dfee26dc0d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Flow 'volume_create_manager' (6eca8342-a3f0-4fd1-9059-cd6fc2714b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:39 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7797180-58e1-4cf2-a1ac-11b21d870c63]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-670ea30a-1abd-4559-93dd-818beaea0825 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.349s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:39 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Deleted volume successfully. Jul 19 17:51:39 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a1b77ec3-cd11-4d63-91d9-69c90c6aadb6 tempest-CinderUnicodeTest-1323252299 None] Created volume successfully. Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-79661bb6-a731-4761-8625-94a3ae87b830 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-83435597-8d4c-4d00-bcff-a3bed055121e-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:39 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-670ea30a-1abd-4559-93dd-818beaea0825 Jul 19 17:51:39 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:39 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 1073741824" returned: 0 in 0.491s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:39 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-670ea30a-1abd-4559-93dd-818beaea0825" returned: 0 in 0.426s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-670ea30a-1abd-4559-93dd-818beaea0825 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:39 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 Jul 19 17:51:39 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:39 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-670ea30a-1abd-4559-93dd-818beaea0825 Jul 19 17:51:39 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:39 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1" returned: 0 in 0.245s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.464s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:39 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e949930-8478-431d-b631-9db34c4184a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54c8ce0-3594-4527-9887-beb038288816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-670ea30a-1abd-4559-93dd-818beaea0825" returned: 0 in 0.261s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] Creating offline snapshot ed59fb70-6216-41b4-b1d0-a04dcf2880ad of volume 8dbda929-b701-4c4b-9a0a-620b86d4aad7 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-quobyte-670ea30a-1abd-4559-93dd-818beaea0825" released by "delete_volume" :: held 0.758s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:39 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Volume volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 (ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1): created successfully Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54c8ce0-3594-4527-9887-beb038288816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Flow 'volume_create_manager' (4dc992c5-f82c-4e28-8582-e5400f0d6c19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e7d70d-efbc-4230-a41b-befeb24367ff]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:39 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-86acff11-780b-4cbe-a4d0-31db076d3144 tempest-VolumeDependencyTests-2031329893 None] Created volume successfully. Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Created reservations ['9e081dc2-a1f4-4c17-84bb-d2816318d4ba', '211491f9-60ee-431e-b7ce-e07d60e2fb0b', '9dbad2b7-9f82-4c4d-95d8-f81a41654cf2', 'a0cc9207-4c8f-4f95-b7a2-d4eb2b6c2ee1'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:40 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 Jul 19 17:51:40 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:40 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:40 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "cinder-249d7760-b724-439b-b7ac-b62f48832464-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:40 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:40 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7" returned: 0 in 0.490s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.343s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-249d7760-b724-439b-b7ac-b62f48832464-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:40 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad 1G Jul 19 17:51:40 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:40 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Deleted volume successfully. Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0e4fb3b4-985a-4372-b23e-c95cb2ce5a3b tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-670ea30a-1abd-4559-93dd-818beaea0825-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "cinder-quobyte-249d7760-b724-439b-b7ac-b62f48832464" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-quobyte-249d7760-b724-439b-b7ac-b62f48832464" acquired by "delete_volume" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcc0e08-64dd-4072-ab90-1ee14fc9d417]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-249d7760-b724-439b-b7ac-b62f48832464 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:40 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-249d7760-b724-439b-b7ac-b62f48832464 Jul 19 17:51:40 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Flow 'volume_create_manager' (aa0841f8-c2e5-4c1b-a363-d41132f1e80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d5d070-8961-4e59-8c09-7da187de9fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d5d070-8961-4e59-8c09-7da187de9fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-947114256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4359704c-9de1-45bf-8e69-6fb3492fee03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3e1e33fbb24193b726d8bab8a83e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:41Z,use_quota=True,user_id='e48509fc31884d35a4f711e6b008270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91842aba-aeac-4128-abb8-f8417b80a6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91842aba-aeac-4128-abb8-f8417b80a6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f02b48e-5377-4807-bd4e-5deefd35fdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f02b48e-5377-4807-bd4e-5deefd35fdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4359704c-9de1-45bf-8e69-6fb3492fee03', 'volume_name': 'volume-4359704c-9de1-45bf-8e69-6fb3492fee03', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6beff4f-9245-4766-baf7-924f8421611a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6beff4f-9245-4766-baf7-924f8421611a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51bf5a3-ceb6-4535-b1c6-f5f18001e534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:40 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Volume 4359704c-9de1-45bf-8e69-6fb3492fee03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4359704c-9de1-45bf-8e69-6fb3492fee03', 'volume_size': 1} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:40 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad 1G" returned: 0 in 0.474s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:40 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad Jul 19 17:51:40 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:40 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-249d7760-b724-439b-b7ac-b62f48832464" returned: 0 in 0.398s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-249d7760-b724-439b-b7ac-b62f48832464 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:40 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-249d7760-b724-439b-b7ac-b62f48832464 Jul 19 17:51:40 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:41 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad" returned: 0 in 0.299s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:41 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad is being set with open permissions: ugo+rw Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:41 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-249d7760-b724-439b-b7ac-b62f48832464" returned: 0 in 0.250s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:41 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad Jul 19 17:51:41 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-quobyte-249d7760-b724-439b-b7ac-b62f48832464" released by "delete_volume" :: held 0.701s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Created reservations ['5bd1bef7-6a6c-4491-991f-1b2355e903fd', '08986721-873e-4ce4-9d85-5efc6982c91e', '33b80ea1-54f7-44a9-8bed-4bd3f379f98f', '18972f7f-655d-41b2-8bf3-936c6e5cf4ba'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:41 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:41 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:41 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad" returned: 0 in 0.254s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:41 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.info Jul 19 17:51:41 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "cinder-111cb3dc-0bbd-44ca-9ebe-f6e243c92851-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:41 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-111cb3dc-0bbd-44ca-9ebe-f6e243c92851-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.259s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:41 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Deleted volume successfully. Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b2815dd0-d1c1-4aa7-ac1a-93890d6d97eb tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-249d7760-b724-439b-b7ac-b62f48832464-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "cinder-quobyte-111cb3dc-0bbd-44ca-9ebe-f6e243c92851" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-quobyte-111cb3dc-0bbd-44ca-9ebe-f6e243c92851" acquired by "delete_volume" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78e9785-7614-4d6f-bd6a-477a7f219fff]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-111cb3dc-0bbd-44ca-9ebe-f6e243c92851 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:41 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.info" returned: 0 in 0.296s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:41 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.info is being set with open permissions: ugo+rw Jul 19 17:51:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:41 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.info Jul 19 17:51:41 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:41 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-111cb3dc-0bbd-44ca-9ebe-f6e243c92851 Jul 19 17:51:41 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:42 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.info" returned: 0 in 0.248s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.188s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.674s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] Creating offline snapshot 08f46d33-6c4d-4b58-b235-21c4bc65d0fd of volume ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:51:42 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-4a175fdd-a4e3-4a68-a20f-07957b09d2a3 tempest-ProjectReaderTests-1730663272 None] Create snapshot completed successfully Jul 19 17:51:42 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f8daf5-0afa-4fed-87b2-f364637198e8]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-111cb3dc-0bbd-44ca-9ebe-f6e243c92851" returned: 0 in 0.391s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-111cb3dc-0bbd-44ca-9ebe-f6e243c92851 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:42 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-111cb3dc-0bbd-44ca-9ebe-f6e243c92851 Jul 19 17:51:42 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:42 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 Jul 19 17:51:42 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:42 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-111cb3dc-0bbd-44ca-9ebe-f6e243c92851" returned: 0 in 0.247s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-quobyte-111cb3dc-0bbd-44ca-9ebe-f6e243c92851" released by "delete_volume" :: held 0.680s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Created reservations ['40115836-3aa2-46dc-a25c-cd6fd4ca0e34', '2a209e36-32f5-4ddd-bc03-0bb45250b0af', 'b5d231fb-18eb-48e3-a601-3596e23c2c43', '5400fbca-c839-4756-afc2-ec9158cd403e'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:42 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1" returned: 0 in 0.364s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:42 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd 1G Jul 19 17:51:42 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:42 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:42 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-ed59fb70-6216-41b4-b1d0-a04dcf2880ad-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Lock "cinder-ed59fb70-6216-41b4-b1d0-a04dcf2880ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-quobyte-8dbda929-b701-4c4b-9a0a-620b86d4aad7" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-8dbda929-b701-4c4b-9a0a-620b86d4aad7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-quobyte-ed59fb70-6216-41b4-b1d0-a04dcf2880ad" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-ed59fb70-6216-41b4-b1d0-a04dcf2880ad" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Deleting offline snapshot ed59fb70-6216-41b4-b1d0-a04dcf2880ad of volume 8dbda929-b701-4c4b-9a0a-620b86d4aad7 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] snapshot_file for this snap is: volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ebad2e-1382-4674-ab77-685c948ad021]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:42 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "cinder-d15c60a9-98dc-4f4f-be04-cbe1a7abb288-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:42 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-d15c60a9-98dc-4f4f-be04-cbe1a7abb288-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "cinder-quobyte-9a3742a0-8575-4216-94f0-99de92477597" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-quobyte-9a3742a0-8575-4216-94f0-99de92477597" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "cinder-quobyte-d15c60a9-98dc-4f4f-be04-cbe1a7abb288" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-quobyte-d15c60a9-98dc-4f4f-be04-cbe1a7abb288" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Deleting offline snapshot d15c60a9-98dc-4f4f-be04-cbe1a7abb288 of volume 9a3742a0-8575-4216-94f0-99de92477597 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:51:42 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] snapshot_file for this snap is: volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.384s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4426eb77-9c6a-47e8-bef7-1f12737f2651]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:42 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Deleted volume successfully. Jul 19 17:51:42 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a34a61ac-756e-4573-84a6-6c23524c4d5d tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-111cb3dc-0bbd-44ca-9ebe-f6e243c92851-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd 1G" returned: 0 in 0.523s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:43 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd Jul 19 17:51:43 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:43 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288 Jul 19 17:51:43 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:43 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad" returned: 0 in 0.425s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cf70d3-6d05-493a-8899-f10c843d9bf7]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:43 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 Jul 19 17:51:43 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:43 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd" returned: 0 in 0.303s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:43 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd is being set with open permissions: ugo+rw Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:43 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288" returned: 0 in 0.387s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a3742a0-8575-4216-94f0-99de92477597(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:51:43 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd Jul 19 17:51:43 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eeca21-f3ef-4911-b067-a1c8bf2f86e2]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:43 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597 Jul 19 17:51:43 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:43 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7" returned: 0 in 0.372s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:43 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad Jul 19 17:51:43 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:43 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd" returned: 0 in 0.265s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:43 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.info Jul 19 17:51:43 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:43 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597" returned: 0 in 0.373s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:43 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288 Jul 19 17:51:43 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:43 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad" returned: 0 in 0.361s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:43 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.info" returned: 0 in 0.298s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:43 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.info is being set with open permissions: ugo+rw Jul 19 17:51:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:43 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad Jul 19 17:51:43 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:43 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.info Jul 19 17:51:43 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:44 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288" returned: 0 in 0.348s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:44 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288 Jul 19 17:51:44 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:44 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7.ed59fb70-6216-41b4-b1d0-a04dcf2880ad" returned: 0 in 0.265s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:44 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.info" returned: 0 in 0.270s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.127s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-ed59fb70-6216-41b4-b1d0-a04dcf2880ad" released by "_delete_snapshot" :: held 1.532s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.352s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-947114256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4359704c-9de1-45bf-8e69-6fb3492fee03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3e1e33fbb24193b726d8bab8a83e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:41Z,use_quota=True,user_id='e48509fc31884d35a4f711e6b008270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Creating volume 4359704c-9de1-45bf-8e69-6fb3492fee03 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:44 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-8dbda929-b701-4c4b-9a0a-620b86d4aad7" released by "delete_snapshot" :: held 1.583s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:44 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03 1073741824 Jul 19 17:51:44 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:44 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-7b95c13d-4dc1-4d29-bb3c-1a390c990840 tempest-VolumeDependencyTests-2031329893 None] Create snapshot completed successfully Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Created reservations ['1fa942cf-ea2c-49a5-abef-fe2674b2d175', '86ba9161-a94d-44a4-9678-aa9ab40264d6', 'af8a8eab-bfb3-4e25-b9fd-227bd70d0f62', '440d57e4-fae3-48a6-ae4a-dbca81e6b48f'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:44 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597.d15c60a9-98dc-4f4f-be04-cbe1a7abb288" returned: 0 in 0.265s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-quobyte-d15c60a9-98dc-4f4f-be04-cbe1a7abb288" released by "_delete_snapshot" :: held 1.481s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:44 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Delete snapshot completed successfully. Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-quobyte-9a3742a0-8575-4216-94f0-99de92477597" released by "delete_snapshot" :: held 1.519s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6a2498e1-6794-4826-b60c-ef56665f512d tempest-ProjectReaderTests-1730663272 None] Lock "cinder-ed59fb70-6216-41b4-b1d0-a04dcf2880ad-delete_snapshot" released by "delete_snapshot" :: held 1.779s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Created reservations ['fbb53e1f-d7bc-4a83-95d1-0d96e779be1e', '38284e75-a33e-47b7-b7bf-c6b4ead7f6e6', '84f1b605-c0bd-4f84-a94b-299f68710c40', 'ff25f81e-45c8-4ba3-bafe-e8b6efac3f08'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:44 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Delete snapshot completed successfully. Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cfe7b2ef-9d49-417c-997c-04d121a7e149 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-d15c60a9-98dc-4f4f-be04-cbe1a7abb288-delete_snapshot" released by "delete_snapshot" :: held 1.686s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:44 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03 1073741824" returned: 0 in 0.457s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:44 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03 Jul 19 17:51:44 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-8dbda929-b701-4c4b-9a0a-620b86d4aad7-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-8dbda929-b701-4c4b-9a0a-620b86d4aad7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-quobyte-8dbda929-b701-4c4b-9a0a-620b86d4aad7" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-8dbda929-b701-4c4b-9a0a-620b86d4aad7" acquired by "delete_volume" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d47d657-168a-4b33-ac47-ec385465f684]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:45 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03" returned: 0 in 0.339s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51bf5a3-ceb6-4535-b1c6-f5f18001e534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4359704c-9de1-45bf-8e69-6fb3492fee03', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a1888f-a6ae-4e8b-add8-819b37f6c93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:45 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Volume volume-4359704c-9de1-45bf-8e69-6fb3492fee03 (4359704c-9de1-45bf-8e69-6fb3492fee03): created successfully Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a1888f-a6ae-4e8b-add8-819b37f6c93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Flow 'volume_create_manager' (aa0841f8-c2e5-4c1b-a363-d41132f1e80d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "cinder-9a3742a0-8575-4216-94f0-99de92477597-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-9a3742a0-8575-4216-94f0-99de92477597-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:45 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-17b85f67-8a61-4e08-8e61-68cb2a7abbbc tempest-CinderUnicodeTest-1323252299 None] Created volume successfully. Jul 19 17:51:45 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 Jul 19 17:51:45 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "cinder-quobyte-9a3742a0-8575-4216-94f0-99de92477597" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-quobyte-9a3742a0-8575-4216-94f0-99de92477597" acquired by "delete_volume" :: waited 0.034s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Flow 'volume_create_manager' (966eb8b0-7541-4681-876d-5ecbf46c05ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36cb68d2-e198-4999-8671-86c61b6f2a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8b5a1e-262e-46c6-b179-757a462f57a7]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36cb68d2-e198-4999-8671-86c61b6f2a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2048070214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf11565-e6d2-4123-909e-7ab88fb3fdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48680553be434e57a38cf3cc0b12f5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=08f46d33-6c4d-4b58-b235-21c4bc65d0fd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:45Z,use_quota=True,user_id='2a1ac627ceb14ee98a8ddaf5fa6c4196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7971c414-8e7a-4b9f-84fa-7d865122fb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7971c414-8e7a-4b9f-84fa-7d865122fb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007809ed-c902-4fdb-858d-e4ad9f1799ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007809ed-c902-4fdb-858d-e4ad9f1799ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'acf11565-e6d2-4123-909e-7ab88fb3fdf7', 'volume_name': 'volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7', 'volume_size': 1, 'snapshot_id': '08f46d33-6c4d-4b58-b235-21c4bc65d0fd'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d28a06-2a89-4d2c-ba13-dcfcea4d996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d28a06-2a89-4d2c-ba13-dcfcea4d996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a44227-2011-4a3f-bfa2-05bc6d295ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:45 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Volume acf11565-e6d2-4123-909e-7ab88fb3fdf7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7', 'volume_size': 1, 'snapshot_id': '08f46d33-6c4d-4b58-b235-21c4bc65d0fd'} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "cinder-quobyte-08f46d33-6c4d-4b58-b235-21c4bc65d0fd-acf11565-e6d2-4123-909e-7ab88fb3fdf7" by "_create_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-quobyte-08f46d33-6c4d-4b58-b235-21c4bc65d0fd-acf11565-e6d2-4123-909e-7ab88fb3fdf7" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Creating volume acf11565-e6d2-4123-909e-7ab88fb3fdf7 from snapshot 08f46d33-6c4d-4b58-b235-21c4bc65d0fd {{(pid=87676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "cinder-quobyte-acf11565-e6d2-4123-909e-7ab88fb3fdf7" by "_copy_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-quobyte-acf11565-e6d2-4123-909e-7ab88fb3fdf7" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] snapshot: 08f46d33-6c4d-4b58-b235-21c4bc65d0fd, volume: acf11565-e6d2-4123-909e-7ab88fb3fdf7, {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 17:51:45 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597 Jul 19 17:51:45 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:45 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7" returned: 0 in 0.507s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e704911-54ce-46ed-9b16-1d78b8e6b490]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:45 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7 Jul 19 17:51:45 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:45 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd Jul 19 17:51:45 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:45 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597" returned: 0 in 0.392s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:45 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8dbda929-b701-4c4b-9a0a-620b86d4aad7" returned: 0 in 0.254s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:45 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597 Jul 19 17:51:45 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-8dbda929-b701-4c4b-9a0a-620b86d4aad7" released by "delete_volume" :: held 0.845s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Created reservations ['a23dfaf4-ffd8-4a5c-8233-a0d392146857', '5af3f12f-fc52-4e54-ba6f-41e2747ef72d', 'f1f7f498-133d-4e3f-8643-8c1f604898a6', '741e43b3-5f81-4adb-9a98-0ce1bf97edc6'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:45 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd" returned: 0 in 0.401s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] will copy from snapshot at /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Creating direct copy from snapshot {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[de254702-4425-4295-a75c-2c6e92060ab5]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:45 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:45 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:45 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-9a3742a0-8575-4216-94f0-99de92477597" returned: 0 in 0.294s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-quobyte-9a3742a0-8575-4216-94f0-99de92477597" released by "delete_volume" :: held 0.787s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:46 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 Jul 19 17:51:46 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Created reservations ['4e6a156d-7e55-405b-b446-58e897fef2f5', '8ccb1e86-4853-4f89-a494-100ab28685b7', '6635d562-f5a6-407b-b69d-ca4bf44c3f72', '52c47bbc-ff9d-494a-8035-23b475f26bb7'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:46 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.337s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:46 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Deleted volume successfully. Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-2630a79d-dec9-406a-ae93-16c5f8fa46c0 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-8dbda929-b701-4c4b-9a0a-620b86d4aad7-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:46 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:46 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:46 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1" returned: 0 in 0.559s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.utils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Path /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7 not found in is_blk_device check {{(pid=87676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:46 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7 Jul 19 17:51:46 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:46 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Flow 'volume_create_manager' (1fba3c99-f8ee-480f-b439-475c30da34cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d817a427-57a2-4b3c-b30e-b86c56d96ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.426s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d817a427-57a2-4b3c-b30e-b86c56d96ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-712230093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903f1a8a-1045-4038-94b7-eb2007c75e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e059d676114b799ce92d9545b79b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:47Z,use_quota=True,user_id='b379d3427ced404ca91a667c316f6239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9485bfc-bde8-4eea-a8f4-01cd91510896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9485bfc-bde8-4eea-a8f4-01cd91510896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e6101f-53e6-48b1-b319-c36fb4b76542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e6101f-53e6-48b1-b319-c36fb4b76542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '903f1a8a-1045-4038-94b7-eb2007c75e6d', 'volume_name': 'volume-903f1a8a-1045-4038-94b7-eb2007c75e6d', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24c95ae-696c-4cea-9d06-86d2ad453f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24c95ae-696c-4cea-9d06-86d2ad453f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfe86e0-904a-447b-b6f4-2b5bfb5dc8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:46 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Volume 903f1a8a-1045-4038-94b7-eb2007c75e6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-903f1a8a-1045-4038-94b7-eb2007c75e6d', 'volume_size': 1} Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:46 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Deleted volume successfully. Jul 19 17:51:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e3febf3b-2647-44c2-9774-1178841248e3 tempest-CreateVolumesFromSnapshotTest-1420105982 None] Lock "cinder-9a3742a0-8575-4216-94f0-99de92477597-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:51 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7" returned: 0 in 5.033s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:51 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7090c135-a481-4674-83b1-4fc1c979c6bb]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:51 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 Jul 19 17:51:51 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:51 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Flow 'volume_create_manager' (dd11f51a-f736-4342-9404-427cd0c19d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7c2e9f-bcb8-4bb8-ace3-2feae1277c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7c2e9f-bcb8-4bb8-ace3-2feae1277c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-247507153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8274134d3c844641a98a3f66cd2e170d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:52Z,use_quota=True,user_id='8ba090d74a154c94a8f1fb165a52002f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48da1233-8980-4504-b493-a516087582ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48da1233-8980-4504-b493-a516087582ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526c6f46-fbc4-45fd-901f-0b7507dda350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526c6f46-fbc4-45fd-901f-0b7507dda350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c', 'volume_name': 'volume-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93df188-2144-4262-a8ff-519c4641f711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93df188-2144-4262-a8ff-519c4641f711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3113718-9624-45cc-843f-08747a3b5cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:51 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume 093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c', 'volume_size': 1} Jul 19 17:51:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:52 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1" returned: 0 in 0.536s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Image conversion details: src /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7 {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:51:52 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Converted 1024.00 MB image at 203.43 MB/s Jul 19 17:51:52 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7 is being set with open permissions: ugo+rw Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:52 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7 Jul 19 17:51:52 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:52 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7" returned: 0 in 0.244s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-quobyte-acf11565-e6d2-4123-909e-7ab88fb3fdf7" released by "_copy_volume_from_snapshot" :: held 6.880s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-quobyte-08f46d33-6c4d-4b58-b235-21c4bc65d0fd-acf11565-e6d2-4123-909e-7ab88fb3fdf7" released by "_create_volume_from_snapshot" :: held 6.908s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.927s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.597s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] Creating offline snapshot e69adad5-84fc-4cd1-a5a8-6e60f911b3ee of volume 4359704c-9de1-45bf-8e69-6fb3492fee03 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a44227-2011-4a3f-bfa2-05bc6d295ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7', 'volume_size': 1, 'snapshot_id': '08f46d33-6c4d-4b58-b235-21c4bc65d0fd'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8573bf-2c0e-46f0-b599-433c2cba56b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b89d1d-fa72-4d1a-ad82-38375f02edb9]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:52 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Volume volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7 (acf11565-e6d2-4123-909e-7ab88fb3fdf7): created successfully Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8573bf-2c0e-46f0-b599-433c2cba56b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Flow 'volume_create_manager' (966eb8b0-7541-4681-876d-5ecbf46c05ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:52 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-34747a9c-7544-49fc-bbef-d60de4191d06 tempest-VolumeDependencyTests-2031329893 None] Created volume successfully. Jul 19 17:51:52 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03 Jul 19 17:51:52 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:52 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03" returned: 0 in 0.352s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:52 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee 1G Jul 19 17:51:52 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "cinder-08f46d33-6c4d-4b58-b235-21c4bc65d0fd-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-08f46d33-6c4d-4b58-b235-21c4bc65d0fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "cinder-quobyte-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-quobyte-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "cinder-quobyte-08f46d33-6c4d-4b58-b235-21c4bc65d0fd" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-quobyte-08f46d33-6c4d-4b58-b235-21c4bc65d0fd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Deleting offline snapshot 08f46d33-6c4d-4b58-b235-21c4bc65d0fd of volume ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] snapshot_file for this snap is: volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7acc612-5681-4960-a31b-5514edc7c3f4]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:53 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd Jul 19 17:51:53 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:53 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee 1G" returned: 0 in 0.404s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4359704c-9de1-45bf-8e69-6fb3492fee03 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:53 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4359704c-9de1-45bf-8e69-6fb3492fee03 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee Jul 19 17:51:53 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:53 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd" returned: 0 in 0.362s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:51:53 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[af77db17-ba9c-49ae-bed9-8612d42685cd]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:53 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4359704c-9de1-45bf-8e69-6fb3492fee03 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee" returned: 0 in 0.303s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:53 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee is being set with open permissions: ugo+rw Jul 19 17:51:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:53 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee Jul 19 17:51:53 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:53 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 Jul 19 17:51:53 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:53 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee" returned: 0 in 0.249s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:53 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1" returned: 0 in 0.375s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:53 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.info Jul 19 17:51:53 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:53 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd Jul 19 17:51:53 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:53 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.info" returned: 0 in 0.269s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:53 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.info is being set with open permissions: ugo+rw Jul 19 17:51:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:53 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.info Jul 19 17:51:53 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:54 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd" returned: 0 in 0.335s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:54 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd Jul 19 17:51:54 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:54 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.info" returned: 0 in 0.254s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.427s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-712230093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903f1a8a-1045-4038-94b7-eb2007c75e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e059d676114b799ce92d9545b79b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:47Z,use_quota=True,user_id='b379d3427ced404ca91a667c316f6239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Creating volume 903f1a8a-1045-4038-94b7-eb2007c75e6d {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:54 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:54 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d 1073741824 Jul 19 17:51:54 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:54 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-60b77930-64b3-494e-9747-607e127a0f27 tempest-CinderUnicodeTest-1323252299 None] Create snapshot completed successfully Jul 19 17:51:54 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1.08f46d33-6c4d-4b58-b235-21c4bc65d0fd" returned: 0 in 0.257s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-quobyte-08f46d33-6c4d-4b58-b235-21c4bc65d0fd" released by "_delete_snapshot" :: held 1.415s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-quobyte-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1" released by "delete_snapshot" :: held 1.438s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Created reservations ['5c012edb-f0c3-4516-bd3e-608d4c1697ea', '4e9b7e39-9c5c-4345-85bd-9c53a710cccd', '2c609bfe-f77d-404c-afc9-e102969b3165', '2171b809-483d-4f7c-b11c-72105efc769a'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:54 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Delete snapshot completed successfully. Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-26499cb8-6f39-45c3-a744-511bd7d9bbca tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-08f46d33-6c4d-4b58-b235-21c4bc65d0fd-delete_snapshot" released by "delete_snapshot" :: held 1.573s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:54 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d 1073741824" returned: 0 in 0.414s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:54 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d Jul 19 17:51:54 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:54 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d" returned: 0 in 0.242s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.092s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-247507153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8274134d3c844641a98a3f66cd2e170d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:52Z,use_quota=True,user_id='8ba090d74a154c94a8f1fb165a52002f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Creating volume 093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:54 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfe86e0-904a-447b-b6f4-2b5bfb5dc8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-903f1a8a-1045-4038-94b7-eb2007c75e6d', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:54 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c 1073741824 Jul 19 17:51:54 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df6b65d-95b2-43e3-a50d-c25f6804e477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:55 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Volume volume-903f1a8a-1045-4038-94b7-eb2007c75e6d (903f1a8a-1045-4038-94b7-eb2007c75e6d): created successfully Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df6b65d-95b2-43e3-a50d-c25f6804e477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Flow 'volume_create_manager' (1fba3c99-f8ee-480f-b439-475c30da34cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Acquiring lock "cinder-e69adad5-84fc-4cd1-a5a8-6e60f911b3ee-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:55 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-24eb772b-19c4-4f9d-8c66-bd067b7baa9c tempest-ProjectReaderTests-1730663272 None] Created volume successfully. Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "cinder-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Lock "cinder-e69adad5-84fc-4cd1-a5a8-6e60f911b3ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Acquiring lock "cinder-quobyte-4359704c-9de1-45bf-8e69-6fb3492fee03" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Lock "cinder-quobyte-4359704c-9de1-45bf-8e69-6fb3492fee03" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Acquiring lock "cinder-quobyte-e69adad5-84fc-4cd1-a5a8-6e60f911b3ee" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "cinder-quobyte-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Lock "cinder-quobyte-e69adad5-84fc-4cd1-a5a8-6e60f911b3ee" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Deleting offline snapshot e69adad5-84fc-4cd1-a5a8-6e60f911b3ee of volume 4359704c-9de1-45bf-8e69-6fb3492fee03 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] snapshot_file for this snap is: volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-quobyte-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1" acquired by "delete_volume" :: waited 0.039s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1358ec9c-7a76-49e3-8ccf-890a1494687e]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[baec8e03-cef4-46a8-bef7-77fa16a6002b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:55 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee Jul 19 17:51:55 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:55 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 Jul 19 17:51:55 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:55 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c 1073741824" returned: 0 in 0.579s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:55 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c Jul 19 17:51:55 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:55 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee" returned: 0 in 0.445s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4359704c-9de1-45bf-8e69-6fb3492fee03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb012f58-389a-4d2a-b988-e83a2eb30788]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:55 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1" returned: 0 in 0.487s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:55 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1 Jul 19 17:51:55 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:55 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03 Jul 19 17:51:55 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:55 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c" returned: 0 in 0.285s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.330s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3113718-9624-45cc-843f-08747a3b5cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a789083c-1228-470a-928a-1d8477382b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] Creating offline snapshot 42f617d7-13dd-43f1-a888-6e239c1a839b of volume 903f1a8a-1045-4038-94b7-eb2007c75e6d {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:51:55 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume volume-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c (093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c): created successfully Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a789083c-1228-470a-928a-1d8477382b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Flow 'volume_create_manager' (dd11f51a-f736-4342-9404-427cd0c19d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dd38e9-7e65-43db-a661-685b4848a7f9]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:55 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c2f87883-8753-4f88-a251-53bb67d743d0 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Created volume successfully. Jul 19 17:51:56 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1" returned: 0 in 0.321s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-quobyte-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1" released by "delete_volume" :: held 0.876s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:56 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d Jul 19 17:51:56 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Created reservations ['96c415c4-abb1-4437-8832-3294b2aacc95', '557acc2c-4128-4f96-ba5c-b218748f976f', '8e6879fd-25f6-4316-a2b5-1172af07cad0', '753906f9-d65e-4973-8cc7-a1e3eee9a4e7'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:56 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03" returned: 0 in 0.543s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:56 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:56 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:56 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee Jul 19 17:51:56 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "cinder-acf11565-e6d2-4123-909e-7ab88fb3fdf7-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-acf11565-e6d2-4123-909e-7ab88fb3fdf7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "cinder-quobyte-acf11565-e6d2-4123-909e-7ab88fb3fdf7" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-quobyte-acf11565-e6d2-4123-909e-7ab88fb3fdf7" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5867fc9-7a16-4e23-827b-1f25ba919411]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:56 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d" returned: 0 in 0.542s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:56 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.323s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:56 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Deleted volume successfully. Jul 19 17:51:56 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b 1G Jul 19 17:51:56 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-17a1d3f7-f147-4817-ad11-42cfa16db34e tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-ec8ad1dc-efcc-4191-8454-e1fdff4d1ae1-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:56 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7 Jul 19 17:51:56 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:56 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee" returned: 0 in 0.505s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:56 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee Jul 19 17:51:56 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:56 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7" returned: 0 in 0.414s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:56 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7 Jul 19 17:51:56 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:57 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b 1G" returned: 0 in 0.540s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-903f1a8a-1045-4038-94b7-eb2007c75e6d -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:57 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03.e69adad5-84fc-4cd1-a5a8-6e60f911b3ee" returned: 0 in 0.311s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:57 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-903f1a8a-1045-4038-94b7-eb2007c75e6d -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b Jul 19 17:51:57 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Lock "cinder-quobyte-e69adad5-84fc-4cd1-a5a8-6e60f911b3ee" released by "_delete_snapshot" :: held 1.950s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Lock "cinder-quobyte-4359704c-9de1-45bf-8e69-6fb3492fee03" released by "delete_snapshot" :: held 1.997s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:57 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-acf11565-e6d2-4123-909e-7ab88fb3fdf7" returned: 0 in 0.296s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Created reservations ['a8e19ef7-7eb4-452f-9ea7-6cd7c2803f74', 'aa3401c7-2562-4638-9120-1f92c6453486', '08e88f9e-4d83-47a6-a7a1-a09d7d8dd2cb', '7266917d-d085-4d21-b183-ad8d1d678858'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-quobyte-acf11565-e6d2-4123-909e-7ab88fb3fdf7" released by "delete_volume" :: held 0.772s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:57 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Delete snapshot completed successfully. Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a08de6fd-9b6b-43c0-9f94-1b0fbe2d7e21 tempest-CinderUnicodeTest-1323252299 None] Lock "cinder-e69adad5-84fc-4cd1-a5a8-6e60f911b3ee-delete_snapshot" released by "delete_snapshot" :: held 2.191s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Created reservations ['f63ba4d5-40e0-4783-8e19-568bb19eb952', 'd0529820-9b43-4603-8150-5672062187aa', 'bb1ca117-551b-4528-9eec-e7e4d29104fd', 'c6e32c75-796f-4c18-a7de-8c1c7c5589ba'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:57 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:57 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:51:57 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-903f1a8a-1045-4038-94b7-eb2007c75e6d -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b" returned: 0 in 0.367s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:57 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b is being set with open permissions: ugo+rw Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:57 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b Jul 19 17:51:57 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:57 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Flow 'volume_create_manager' (93c6a2a2-183c-409a-9b92-75efad2f4ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cdc717-d42e-4813-9af6-f437132af0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.332s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:51:57 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Deleted volume successfully. Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cdc717-d42e-4813-9af6-f437132af0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-184965891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be759058-a3b2-4a4b-9463-76e553c54301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8274134d3c844641a98a3f66cd2e170d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:58Z,use_quota=True,user_id='8ba090d74a154c94a8f1fb165a52002f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8436a020-9dbc-49ec-a532-a781ff34847c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8436a020-9dbc-49ec-a532-a781ff34847c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2482e8-1e45-451a-bd08-1b20d55fba04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2482e8-1e45-451a-bd08-1b20d55fba04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be759058-a3b2-4a4b-9463-76e553c54301', 'volume_name': 'volume-be759058-a3b2-4a4b-9463-76e553c54301', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee5b09b-540c-4613-958f-69b792f90728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee5b09b-540c-4613-958f-69b792f90728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8e3f8a-8d52-4990-a5af-faf70d81c76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:57 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume be759058-a3b2-4a4b-9463-76e553c54301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be759058-a3b2-4a4b-9463-76e553c54301', 'volume_size': 1} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7d6a6fcb-dbc0-4482-b3ae-df968079b510 tempest-VolumeDependencyTests-2031329893 None] Lock "cinder-acf11565-e6d2-4123-909e-7ab88fb3fdf7-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:57 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b" returned: 0 in 0.444s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:57 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.info Jul 19 17:51:57 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Flow 'volume_create_manager' (8496ae23-0151-43b7-b409-f7f2bf3a5bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13741b3c-4381-4f66-a180-f487284f4eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13741b3c-4381-4f66-a180-f487284f4eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-767306257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94abbc7a-372e-44cd-b8d3-69e9edbd99a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8274134d3c844641a98a3f66cd2e170d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:58Z,use_quota=True,user_id='8ba090d74a154c94a8f1fb165a52002f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0802a64a-ffc5-4a7a-9ba2-bc8fa82df246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0802a64a-ffc5-4a7a-9ba2-bc8fa82df246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731e990b-71ad-4283-bd6c-47d9746f385c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731e990b-71ad-4283-bd6c-47d9746f385c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94abbc7a-372e-44cd-b8d3-69e9edbd99a2', 'volume_name': 'volume-94abbc7a-372e-44cd-b8d3-69e9edbd99a2', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c51f96c-41de-488b-9ab1-f2d9ced32670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c51f96c-41de-488b-9ab1-f2d9ced32670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c983ad65-625f-42a2-9a64-14de1eed8f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:58 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume 94abbc7a-372e-44cd-b8d3-69e9edbd99a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94abbc7a-372e-44cd-b8d3-69e9edbd99a2', 'volume_size': 1} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:58 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.info" returned: 0 in 0.432s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:58 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.info is being set with open permissions: ugo+rw Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:58 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.info Jul 19 17:51:58 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Acquiring lock "cinder-4359704c-9de1-45bf-8e69-6fb3492fee03-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Lock "cinder-4359704c-9de1-45bf-8e69-6fb3492fee03-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Acquiring lock "cinder-quobyte-4359704c-9de1-45bf-8e69-6fb3492fee03" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Flow 'volume_create_manager' (05e4a85f-6e44-450e-ba48-69ac5ceb3fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe06985-3b33-4904-b46e-ee3364dd4175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe06985-3b33-4904-b46e-ee3364dd4175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-91608692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e79eb7-51f0-4045-bee5-df347faec87b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8274134d3c844641a98a3f66cd2e170d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:58Z,use_quota=True,user_id='8ba090d74a154c94a8f1fb165a52002f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed10d2c-a07c-4541-b362-28a70beac71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed10d2c-a07c-4541-b362-28a70beac71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71bd5f5-37be-48ff-86a8-37298eeb8a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71bd5f5-37be-48ff-86a8-37298eeb8a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81e79eb7-51f0-4045-bee5-df347faec87b', 'volume_name': 'volume-81e79eb7-51f0-4045-bee5-df347faec87b', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11722182-f534-4562-845f-8446d2d882e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11722182-f534-4562-845f-8446d2d882e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281b3c30-0716-430a-8f35-f56afb6278d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:58 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume 81e79eb7-51f0-4045-bee5-df347faec87b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81e79eb7-51f0-4045-bee5-df347faec87b', 'volume_size': 1} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Lock "cinder-quobyte-4359704c-9de1-45bf-8e69-6fb3492fee03" acquired by "delete_volume" :: waited 0.129s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5da412-1b35-41e3-bf96-5a19775dd999]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:58 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.info" returned: 0 in 0.435s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.927s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.025s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-184965891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be759058-a3b2-4a4b-9463-76e553c54301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8274134d3c844641a98a3f66cd2e170d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:58Z,use_quota=True,user_id='8ba090d74a154c94a8f1fb165a52002f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Creating volume be759058-a3b2-4a4b-9463-76e553c54301 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:58 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be759058-a3b2-4a4b-9463-76e553c54301 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:58 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03 Jul 19 17:51:58 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:58 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be759058-a3b2-4a4b-9463-76e553c54301 1073741824 Jul 19 17:51:58 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:58 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-dcdf7427-0f26-4037-bea7-b481fa8ee53b tempest-ProjectReaderTests-1730663272 None] Create snapshot completed successfully Jul 19 17:51:58 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Flow 'volume_create_manager' (105d32ac-5d67-4c23-a2f4-50ce3043bf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0eb7d1d-66cc-42d3-a017-5e2e8f84b01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0eb7d1d-66cc-42d3-a017-5e2e8f84b01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-974208568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59f0f2c-5199-4116-88bd-dd723aba21d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8274134d3c844641a98a3f66cd2e170d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:59Z,use_quota=True,user_id='8ba090d74a154c94a8f1fb165a52002f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431093a1-f083-49b7-b4fc-fcb5eb4c4fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431093a1-f083-49b7-b4fc-fcb5eb4c4fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc778e6-b738-4521-8f84-719acef058a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc778e6-b738-4521-8f84-719acef058a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b59f0f2c-5199-4116-88bd-dd723aba21d4', 'volume_name': 'volume-b59f0f2c-5199-4116-88bd-dd723aba21d4', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7f7468-8a6f-4f7b-b2a2-c5dff4b62955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7f7468-8a6f-4f7b-b2a2-c5dff4b62955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71476d53-de40-46cd-a27c-35cef537b48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:59 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume b59f0f2c-5199-4116-88bd-dd723aba21d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b59f0f2c-5199-4116-88bd-dd723aba21d4', 'volume_size': 1} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:59 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03" returned: 0 in 0.615s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:59 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03 Jul 19 17:51:59 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:59 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be759058-a3b2-4a4b-9463-76e553c54301 1073741824" returned: 0 in 0.628s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be759058-a3b2-4a4b-9463-76e553c54301 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:59 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be759058-a3b2-4a4b-9463-76e553c54301 Jul 19 17:51:59 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:51:59 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Flow 'volume_create_manager' (bee1b576-0218-4b50-9a30-59cbab37f92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae1ada9-3fa3-4b5e-92da-7257ede57695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4359704c-9de1-45bf-8e69-6fb3492fee03" returned: 0 in 0.367s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae1ada9-3fa3-4b5e-92da-7257ede57695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-930986029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c4fb13-7fea-425f-982f-396726187570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8274134d3c844641a98a3f66cd2e170d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:59Z,use_quota=True,user_id='8ba090d74a154c94a8f1fb165a52002f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e432ab-c1a6-4ffb-844b-6ae89545480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e432ab-c1a6-4ffb-844b-6ae89545480d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67511c43-bd74-4610-b9cf-67106aaabb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67511c43-bd74-4610-b9cf-67106aaabb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54c4fb13-7fea-425f-982f-396726187570', 'volume_name': 'volume-54c4fb13-7fea-425f-982f-396726187570', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5057f3a0-27ba-4f54-b704-cb2b6127a196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5057f3a0-27ba-4f54-b704-cb2b6127a196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10f8ea7-d135-4532-b52a-c04754a7cbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:59 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume 54c4fb13-7fea-425f-982f-396726187570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54c4fb13-7fea-425f-982f-396726187570', 'volume_size': 1} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Lock "cinder-quobyte-4359704c-9de1-45bf-8e69-6fb3492fee03" released by "delete_volume" :: held 1.097s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Created reservations ['e93b8c95-a545-4f2e-95ac-7124150e8d6e', '7a42192a-7638-428e-9ed8-dc8fb8df886b', '9d0276f6-1b0c-4613-92c1-57e3f57781ce', 'a2aebc78-ffff-4be1-9ed7-5bd90e8fa119'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:51:59 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be759058-a3b2-4a4b-9463-76e553c54301" returned: 0 in 0.353s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.678s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-767306257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94abbc7a-372e-44cd-b8d3-69e9edbd99a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8274134d3c844641a98a3f66cd2e170d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:58Z,use_quota=True,user_id='8ba090d74a154c94a8f1fb165a52002f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Creating volume 94abbc7a-372e-44cd-b8d3-69e9edbd99a2 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:51:59 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-94abbc7a-372e-44cd-b8d3-69e9edbd99a2 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-42f617d7-13dd-43f1-a888-6e239c1a839b-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:59 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-94abbc7a-372e-44cd-b8d3-69e9edbd99a2 1073741824 Jul 19 17:51:59 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8e3f8a-8d52-4990-a5af-faf70d81c76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be759058-a3b2-4a4b-9463-76e553c54301', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9776d325-5662-45ac-ab39-912942bfee83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Lock "cinder-42f617d7-13dd-43f1-a888-6e239c1a839b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-quobyte-903f1a8a-1045-4038-94b7-eb2007c75e6d" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:59 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume volume-be759058-a3b2-4a4b-9463-76e553c54301 (be759058-a3b2-4a4b-9463-76e553c54301): created successfully Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9776d325-5662-45ac-ab39-912942bfee83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Flow 'volume_create_manager' (93c6a2a2-183c-409a-9b92-75efad2f4ebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-903f1a8a-1045-4038-94b7-eb2007c75e6d" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:51:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-quobyte-42f617d7-13dd-43f1-a888-6e239c1a839b" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:51:59 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a3f7a235-cced-4a37-9133-7bc8d3cc6c2f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Created volume successfully. Jul 19 17:51:59 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:00 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-42f617d7-13dd-43f1-a888-6e239c1a839b" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Deleting offline snapshot 42f617d7-13dd-43f1-a888-6e239c1a839b of volume 903f1a8a-1045-4038-94b7-eb2007c75e6d {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] snapshot_file for this snap is: volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[73590efa-7ed2-47a9-b194-0e2cd2417349]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:00 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b Jul 19 17:52:00 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:00 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.320s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:00 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Deleted volume successfully. Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1ed7c9b5-2712-4e90-8ebd-3ac287283e19 tempest-CinderUnicodeTest-1323252299 None] Lock "cinder-4359704c-9de1-45bf-8e69-6fb3492fee03-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:00 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-94abbc7a-372e-44cd-b8d3-69e9edbd99a2 1073741824" returned: 0 in 0.515s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-94abbc7a-372e-44cd-b8d3-69e9edbd99a2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:00 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-94abbc7a-372e-44cd-b8d3-69e9edbd99a2 Jul 19 17:52:00 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:00 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b" returned: 0 in 0.449s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-903f1a8a-1045-4038-94b7-eb2007c75e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df91a0b-3e3a-4a87-b03d-415ceb8f52ca]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:00 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d Jul 19 17:52:00 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:00 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-94abbc7a-372e-44cd-b8d3-69e9edbd99a2" returned: 0 in 0.282s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.084s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-91608692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e79eb7-51f0-4045-bee5-df347faec87b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8274134d3c844641a98a3f66cd2e170d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:58Z,use_quota=True,user_id='8ba090d74a154c94a8f1fb165a52002f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Creating volume 81e79eb7-51f0-4045-bee5-df347faec87b {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:00 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-81e79eb7-51f0-4045-bee5-df347faec87b 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:00 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-81e79eb7-51f0-4045-bee5-df347faec87b 1073741824 Jul 19 17:52:00 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c983ad65-625f-42a2-9a64-14de1eed8f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94abbc7a-372e-44cd-b8d3-69e9edbd99a2', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5f0fde-98dd-4a61-be9c-90aa4181cea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Acquiring lock "cinder-8299c321-fe99-44e6-9dec-e7087582fff9-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:00 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume volume-94abbc7a-372e-44cd-b8d3-69e9edbd99a2 (94abbc7a-372e-44cd-b8d3-69e9edbd99a2): created successfully Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5f0fde-98dd-4a61-be9c-90aa4181cea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Flow 'volume_create_manager' (8496ae23-0151-43b7-b409-f7f2bf3a5bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Lock "cinder-8299c321-fe99-44e6-9dec-e7087582fff9-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:00 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-15106fd5-261b-41d3-9a71-09a1551a0510 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Created volume successfully. Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Acquiring lock "cinder-quobyte-8299c321-fe99-44e6-9dec-e7087582fff9" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Lock "cinder-quobyte-8299c321-fe99-44e6-9dec-e7087582fff9" acquired by "delete_volume" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ab4170-2ab0-4f9e-a0ef-6c3d9ff6731e]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8299c321-fe99-44e6-9dec-e7087582fff9 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:00 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d" returned: 0 in 0.416s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:00 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b Jul 19 17:52:01 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:01 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8299c321-fe99-44e6-9dec-e7087582fff9 Jul 19 17:52:01 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:01 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-81e79eb7-51f0-4045-bee5-df347faec87b 1073741824" returned: 0 in 0.598s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-81e79eb7-51f0-4045-bee5-df347faec87b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:01 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8299c321-fe99-44e6-9dec-e7087582fff9" returned: 0 in 0.433s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8299c321-fe99-44e6-9dec-e7087582fff9 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:01 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-81e79eb7-51f0-4045-bee5-df347faec87b Jul 19 17:52:01 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:01 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8299c321-fe99-44e6-9dec-e7087582fff9 Jul 19 17:52:01 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:01 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b" returned: 0 in 0.456s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:01 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b Jul 19 17:52:01 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:01 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-81e79eb7-51f0-4045-bee5-df347faec87b" returned: 0 in 0.305s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.529s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-974208568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59f0f2c-5199-4116-88bd-dd723aba21d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8274134d3c844641a98a3f66cd2e170d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:59Z,use_quota=True,user_id='8ba090d74a154c94a8f1fb165a52002f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Creating volume b59f0f2c-5199-4116-88bd-dd723aba21d4 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:01 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b59f0f2c-5199-4116-88bd-dd723aba21d4 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:01 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b59f0f2c-5199-4116-88bd-dd723aba21d4 1073741824 Jul 19 17:52:01 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281b3c30-0716-430a-8f35-f56afb6278d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e79eb7-51f0-4045-bee5-df347faec87b', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073563cf-683f-415b-acf0-748912997021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:01 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume volume-81e79eb7-51f0-4045-bee5-df347faec87b (81e79eb7-51f0-4045-bee5-df347faec87b): created successfully Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073563cf-683f-415b-acf0-748912997021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:01 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Flow 'volume_create_manager' (05e4a85f-6e44-450e-ba48-69ac5ceb3fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8299c321-fe99-44e6-9dec-e7087582fff9" returned: 0 in 0.383s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:01 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d.42f617d7-13dd-43f1-a888-6e239c1a839b" returned: 0 in 0.355s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Lock "cinder-quobyte-8299c321-fe99-44e6-9dec-e7087582fff9" released by "delete_volume" :: held 0.898s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:01 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-cb664fd6-c67d-471c-b58d-2a027a791c5d tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Created volume successfully. Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-42f617d7-13dd-43f1-a888-6e239c1a839b" released by "_delete_snapshot" :: held 1.809s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-903f1a8a-1045-4038-94b7-eb2007c75e6d" released by "delete_snapshot" :: held 1.852s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Created reservations ['8a4dc393-6bab-45a0-b9c7-7aef79ad9f27', '22046829-4a36-464b-90ef-6d4297ddcac7', 'a756f7a7-2a61-4a1d-8f28-05faae5a02cb', 'b1a8d9a2-f9bd-4303-83a3-6de5eec0c36c'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:01 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Created reservations ['924029e5-78f7-4c50-8ae9-d011a5be0542', '4d487331-9aea-430e-bffd-f6739eede74f', '75e41dff-5e6f-4221-a0b6-0dac488f48bf', 'cbf3cd1d-8b28-4800-89be-9f37f9c47daa'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:02 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:02 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:02 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Delete snapshot completed successfully. Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-903f1a8a-1045-4038-94b7-eb2007c75e6d-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8685d1d7-5e49-4fb9-8a65-443dd353878f tempest-ProjectReaderTests-1730663272 None] Lock "cinder-42f617d7-13dd-43f1-a888-6e239c1a839b-delete_snapshot" released by "delete_snapshot" :: held 2.191s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-903f1a8a-1045-4038-94b7-eb2007c75e6d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-quobyte-903f1a8a-1045-4038-94b7-eb2007c75e6d" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-903f1a8a-1045-4038-94b7-eb2007c75e6d" acquired by "delete_volume" :: waited 0.015s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[568538f1-a567-4d0e-9cd8-e04b81af83cd]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:02 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b59f0f2c-5199-4116-88bd-dd723aba21d4 1073741824" returned: 0 in 0.643s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b59f0f2c-5199-4116-88bd-dd723aba21d4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:02 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:02 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.333s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:02 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:02 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Deleted volume successfully. Jul 19 17:52:02 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b59f0f2c-5199-4116-88bd-dd723aba21d4 Jul 19 17:52:02 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-98f94c53-2f11-4506-b701-1c0db970b9a1 tempest-CinderUnicodeTest-1323252299 None] Lock "cinder-8299c321-fe99-44e6-9dec-e7087582fff9-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:02 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d" returned: 0 in 0.401s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:02 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b59f0f2c-5199-4116-88bd-dd723aba21d4" returned: 0 in 0.300s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.976s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-930986029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c4fb13-7fea-425f-982f-396726187570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8274134d3c844641a98a3f66cd2e170d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:51:59Z,use_quota=True,user_id='8ba090d74a154c94a8f1fb165a52002f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Creating volume 54c4fb13-7fea-425f-982f-396726187570 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:02 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d Jul 19 17:52:02 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:02 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-54c4fb13-7fea-425f-982f-396726187570 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:02 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-54c4fb13-7fea-425f-982f-396726187570 1073741824 Jul 19 17:52:02 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71476d53-de40-46cd-a27c-35cef537b48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b59f0f2c-5199-4116-88bd-dd723aba21d4', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9bcca02-d517-47b4-aac7-8d18371ccaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:02 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume volume-b59f0f2c-5199-4116-88bd-dd723aba21d4 (b59f0f2c-5199-4116-88bd-dd723aba21d4): created successfully Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9bcca02-d517-47b4-aac7-8d18371ccaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Flow 'volume_create_manager' (105d32ac-5d67-4c23-a2f4-50ce3043bf98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:02 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c5821765-fee4-4d87-a8f5-48faa9b40952 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Created volume successfully. Jul 19 17:52:02 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-903f1a8a-1045-4038-94b7-eb2007c75e6d" returned: 0 in 0.333s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-903f1a8a-1045-4038-94b7-eb2007c75e6d" released by "delete_volume" :: held 0.823s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Created reservations ['18a51e69-694b-4231-8990-201147e5c835', '6918e381-018a-41fd-b4ef-8aec71c9f3d3', 'c22ef9b9-b9e3-4f1f-9da7-8098ed78ab2d', '93602be0-eedf-4dec-8019-7a1050721b65'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:03 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:03 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:03 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-54c4fb13-7fea-425f-982f-396726187570 1073741824" returned: 0 in 0.571s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-54c4fb13-7fea-425f-982f-396726187570 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:03 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-54c4fb13-7fea-425f-982f-396726187570 Jul 19 17:52:03 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:03 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.328s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:03 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Deleted volume successfully. Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d49857e7-fcf0-49af-91db-e56d45210ae2 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-903f1a8a-1045-4038-94b7-eb2007c75e6d-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:03 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-54c4fb13-7fea-425f-982f-396726187570" returned: 0 in 0.325s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10f8ea7-d135-4532-b52a-c04754a7cbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54c4fb13-7fea-425f-982f-396726187570', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455c7f66-718e-4309-8ded-186d35b7dc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:03 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Volume volume-54c4fb13-7fea-425f-982f-396726187570 (54c4fb13-7fea-425f-982f-396726187570): created successfully Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455c7f66-718e-4309-8ded-186d35b7dc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Flow 'volume_create_manager' (bee1b576-0218-4b50-9a30-59cbab37f92b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:03 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-5344f5cb-ac54-4c38-bf53-dab7eba0fbef tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Created volume successfully. Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Flow 'volume_create_manager' (a3c4ea2a-ea17-40b1-bc24-9d27fb0049e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bb518d-eac6-41bb-b1ed-db486fbd6661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bb518d-eac6-41bb-b1ed-db486fbd6661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-383153218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3406ed-3f00-48bb-8f02-6184e82f207e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e059d676114b799ce92d9545b79b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:04Z,use_quota=True,user_id='b379d3427ced404ca91a667c316f6239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df4c4b5-9264-4392-8dd1-0f50be9bd4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df4c4b5-9264-4392-8dd1-0f50be9bd4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:03 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c216949d-8ebd-4cbd-9a1c-7cf842c0655f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c216949d-8ebd-4cbd-9a1c-7cf842c0655f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c3406ed-3f00-48bb-8f02-6184e82f207e', 'volume_name': 'volume-5c3406ed-3f00-48bb-8f02-6184e82f207e', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cca7a0-458c-4d20-a9d9-bdbfb705c14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cca7a0-458c-4d20-a9d9-bdbfb705c14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d055be38-479e-4a58-b313-d90a592fcebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:04 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Volume 5c3406ed-3f00-48bb-8f02-6184e82f207e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c3406ed-3f00-48bb-8f02-6184e82f207e', 'volume_size': 1} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-383153218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3406ed-3f00-48bb-8f02-6184e82f207e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e059d676114b799ce92d9545b79b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:04Z,use_quota=True,user_id='b379d3427ced404ca91a667c316f6239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Creating volume 5c3406ed-3f00-48bb-8f02-6184e82f207e {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:04 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:04 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e 1073741824 Jul 19 17:52:04 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "cinder-54c4fb13-7fea-425f-982f-396726187570-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-54c4fb13-7fea-425f-982f-396726187570-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "cinder-quobyte-54c4fb13-7fea-425f-982f-396726187570" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-quobyte-54c4fb13-7fea-425f-982f-396726187570" acquired by "delete_volume" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcdeee1-f4e1-4edc-aa2d-82c94562be49]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-54c4fb13-7fea-425f-982f-396726187570 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:04 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-54c4fb13-7fea-425f-982f-396726187570 Jul 19 17:52:04 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:04 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e 1073741824" returned: 0 in 0.679s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:04 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e Jul 19 17:52:04 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:04 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-54c4fb13-7fea-425f-982f-396726187570" returned: 0 in 0.452s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-54c4fb13-7fea-425f-982f-396726187570 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:04 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-54c4fb13-7fea-425f-982f-396726187570 Jul 19 17:52:04 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:05 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e" returned: 0 in 0.391s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d055be38-479e-4a58-b313-d90a592fcebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c3406ed-3f00-48bb-8f02-6184e82f207e', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6dcd962-551b-4065-8d84-5d147ffa4d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:05 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Volume volume-5c3406ed-3f00-48bb-8f02-6184e82f207e (5c3406ed-3f00-48bb-8f02-6184e82f207e): created successfully Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6dcd962-551b-4065-8d84-5d147ffa4d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Flow 'volume_create_manager' (a3c4ea2a-ea17-40b1-bc24-9d27fb0049e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:05 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-54c4fb13-7fea-425f-982f-396726187570" returned: 0 in 0.364s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-quobyte-54c4fb13-7fea-425f-982f-396726187570" released by "delete_volume" :: held 0.880s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:05 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ba93115d-3c33-48ac-b4bc-f219216981ff tempest-ProjectReaderTests-1730663272 None] Created volume successfully. Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Created reservations ['6fc2353b-50b1-4569-afc1-6624e8728cca', 'a4922baa-19db-4697-9c6b-b9514b8a3a54', '2e6b1fea-5679-4028-a20f-170e62c33e20', 'c4ab0d7a-5755-4ec7-9ff3-72d306c0d283'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:05 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:05 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "cinder-b59f0f2c-5199-4116-88bd-dd723aba21d4-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-b59f0f2c-5199-4116-88bd-dd723aba21d4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "cinder-quobyte-b59f0f2c-5199-4116-88bd-dd723aba21d4" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-quobyte-b59f0f2c-5199-4116-88bd-dd723aba21d4" acquired by "delete_volume" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[03984efa-1407-43de-ba30-6e962a3d1118]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b59f0f2c-5199-4116-88bd-dd723aba21d4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:05 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.397s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:05 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Deleted volume successfully. Jul 19 17:52:05 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e5aa5bfe-9ffc-45b5-9f99-46a21403bc2e tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-54c4fb13-7fea-425f-982f-396726187570-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:05 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b59f0f2c-5199-4116-88bd-dd723aba21d4 Jul 19 17:52:05 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:06 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b59f0f2c-5199-4116-88bd-dd723aba21d4" returned: 0 in 0.452s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b59f0f2c-5199-4116-88bd-dd723aba21d4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:06 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b59f0f2c-5199-4116-88bd-dd723aba21d4 Jul 19 17:52:06 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] Creating offline snapshot c6a6c437-1b61-49b9-be22-56096baae654 of volume 5c3406ed-3f00-48bb-8f02-6184e82f207e {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[462a9cc8-d357-4578-8f8c-4d6be7e41fad]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:06 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e Jul 19 17:52:06 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:06 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b59f0f2c-5199-4116-88bd-dd723aba21d4" returned: 0 in 0.323s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-quobyte-b59f0f2c-5199-4116-88bd-dd723aba21d4" released by "delete_volume" :: held 0.819s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Created reservations ['529d6be5-96f6-4c88-bf16-d28ca8aa6e9a', 'f356af4d-e658-4669-8304-5e134a1b24d1', 'b6b2e30c-7e88-4c04-a741-8b6724343275', '060e6c03-89c0-46bc-9927-735d7c978ce4'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:06 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:06 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "cinder-81e79eb7-51f0-4045-bee5-df347faec87b-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:06 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e" returned: 0 in 0.474s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-81e79eb7-51f0-4045-bee5-df347faec87b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:06 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654 1G Jul 19 17:52:06 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "cinder-quobyte-81e79eb7-51f0-4045-bee5-df347faec87b" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-quobyte-81e79eb7-51f0-4045-bee5-df347faec87b" acquired by "delete_volume" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f10c66a-b12d-44a7-9682-9440b3fa1f75]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-81e79eb7-51f0-4045-bee5-df347faec87b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:07 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.406s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:07 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Deleted volume successfully. Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-d188e39a-0914-42f9-bdb3-7f1848126f47 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-b59f0f2c-5199-4116-88bd-dd723aba21d4-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:07 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-81e79eb7-51f0-4045-bee5-df347faec87b Jul 19 17:52:07 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:07 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654 1G" returned: 0 in 0.637s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c3406ed-3f00-48bb-8f02-6184e82f207e -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:07 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-81e79eb7-51f0-4045-bee5-df347faec87b" returned: 0 in 0.488s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-81e79eb7-51f0-4045-bee5-df347faec87b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:07 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c3406ed-3f00-48bb-8f02-6184e82f207e -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654 Jul 19 17:52:07 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:07 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-81e79eb7-51f0-4045-bee5-df347faec87b Jul 19 17:52:07 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:07 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-81e79eb7-51f0-4045-bee5-df347faec87b" returned: 0 in 0.266s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-quobyte-81e79eb7-51f0-4045-bee5-df347faec87b" released by "delete_volume" :: held 0.827s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:07 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c3406ed-3f00-48bb-8f02-6184e82f207e -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654" returned: 0 in 0.362s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:07 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654 is being set with open permissions: ugo+rw Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:07 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654 Jul 19 17:52:07 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Created reservations ['6b9643f0-9f35-40bc-84ac-99740b72ca20', 'abed1098-1871-4503-9b2d-0741e7f85c36', '034704e7-5689-4ca9-957d-cfc1f2ceacd4', '77d902e5-81bb-4cd1-82fb-e25d26d2de7d'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:07 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:07 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "cinder-94abbc7a-372e-44cd-b8d3-69e9edbd99a2-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-94abbc7a-372e-44cd-b8d3-69e9edbd99a2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:08 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654" returned: 0 in 0.345s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "cinder-quobyte-94abbc7a-372e-44cd-b8d3-69e9edbd99a2" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:08 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.info Jul 19 17:52:08 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-quobyte-94abbc7a-372e-44cd-b8d3-69e9edbd99a2" acquired by "delete_volume" :: waited 0.044s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:08 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.375s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:08 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Deleted volume successfully. Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[020e1fdb-bfd3-43ba-9f54-78f350be4583]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-94abbc7a-372e-44cd-b8d3-69e9edbd99a2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8992873c-4cd0-41fe-a107-812abfe590fb tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-81e79eb7-51f0-4045-bee5-df347faec87b-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:08 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-94abbc7a-372e-44cd-b8d3-69e9edbd99a2 Jul 19 17:52:08 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:08 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.info" returned: 0 in 0.409s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:08 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.info is being set with open permissions: ugo+rw Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:08 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.info Jul 19 17:52:08 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:08 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-94abbc7a-372e-44cd-b8d3-69e9edbd99a2" returned: 0 in 0.459s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-94abbc7a-372e-44cd-b8d3-69e9edbd99a2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:08 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-94abbc7a-372e-44cd-b8d3-69e9edbd99a2 Jul 19 17:52:08 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:08 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.info" returned: 0 in 0.300s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.658s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (74bf300e-b6af-4d21-972b-d68cdd448087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236050a9-4e29-4450-9347-4afd5c424fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:08 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-bf1df53a-0c3a-4316-a80c-42f4bec23bd6 tempest-ProjectReaderTests-1730663272 None] Create snapshot completed successfully Jul 19 17:52:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236050a9-4e29-4450-9347-4afd5c424fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503404643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c2b5a5-c011-4b3b-a6cc-e9950b473bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:09Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2a0dbe-84d7-4474-8bdb-eed44f5fa926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2a0dbe-84d7-4474-8bdb-eed44f5fa926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b94c09-16aa-4f89-aedd-1dad0518006f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b94c09-16aa-4f89-aedd-1dad0518006f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88c2b5a5-c011-4b3b-a6cc-e9950b473bab', 'volume_name': 'volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1834ca2-1390-4dbf-8600-3295f3a5127c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1834ca2-1390-4dbf-8600-3295f3a5127c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5d2bbc-b7ca-4029-9d8c-0231af38d0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:09 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Volume 88c2b5a5-c011-4b3b-a6cc-e9950b473bab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab', 'volume_size': 1} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503404643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c2b5a5-c011-4b3b-a6cc-e9950b473bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:09Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Creating volume 88c2b5a5-c011-4b3b-a6cc-e9950b473bab {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:09 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:09 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-94abbc7a-372e-44cd-b8d3-69e9edbd99a2" returned: 0 in 0.330s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:09 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab 1073741824 Jul 19 17:52:09 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-quobyte-94abbc7a-372e-44cd-b8d3-69e9edbd99a2" released by "delete_volume" :: held 0.860s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Created reservations ['4616481c-6f09-4814-ad40-e55e6d662101', '5850bae1-cf95-4c28-aade-fab2f2143acf', '1cbd6407-8bc2-4942-8ce3-669887df8993', '78371528-6551-4f95-9492-1ff2cf129471'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:09 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:09 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:09 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab 1073741824" returned: 0 in 0.538s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:09 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.316s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:09 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Deleted volume successfully. Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6ee62797-a8de-4617-bdc0-604c861f6e3f tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-94abbc7a-372e-44cd-b8d3-69e9edbd99a2-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:09 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab Jul 19 17:52:09 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-c6a6c437-1b61-49b9-be22-56096baae654-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-c6a6c437-1b61-49b9-be22-56096baae654-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-quobyte-5c3406ed-3f00-48bb-8f02-6184e82f207e" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-5c3406ed-3f00-48bb-8f02-6184e82f207e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-quobyte-c6a6c437-1b61-49b9-be22-56096baae654" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-c6a6c437-1b61-49b9-be22-56096baae654" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Deleting offline snapshot c6a6c437-1b61-49b9-be22-56096baae654 of volume 5c3406ed-3f00-48bb-8f02-6184e82f207e {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] snapshot_file for this snap is: volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbb56a3-c583-4b69-808b-83fff3415153]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:09 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab" returned: 0 in 0.320s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:09 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654 Jul 19 17:52:09 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5d2bbc-b7ca-4029-9d8c-0231af38d0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e215ca03-2660-47fa-b166-053a998adc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:10 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Volume volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab (88c2b5a5-c011-4b3b-a6cc-e9950b473bab): created successfully Jul 19 17:52:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e215ca03-2660-47fa-b166-053a998adc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (74bf300e-b6af-4d21-972b-d68cdd448087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:10 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-28272fb4-87b1-4a4a-899b-b3f20ee37857 tempest-ProjectMemberTests-1812963129 None] Created volume successfully. Jul 19 17:52:10 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654" returned: 0 in 0.375s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c3406ed-3f00-48bb-8f02-6184e82f207e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:52:10 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f0d234-87c8-4e8e-8bd9-0178a7affdbf]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "cinder-be759058-a3b2-4a4b-9463-76e553c54301-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-be759058-a3b2-4a4b-9463-76e553c54301-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:10 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e Jul 19 17:52:10 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "cinder-quobyte-be759058-a3b2-4a4b-9463-76e553c54301" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:10 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-quobyte-be759058-a3b2-4a4b-9463-76e553c54301" acquired by "delete_volume" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:10 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c004a5b8-40d7-4cc8-877d-d2d9d7e552de]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be759058-a3b2-4a4b-9463-76e553c54301 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:10 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be759058-a3b2-4a4b-9463-76e553c54301 Jul 19 17:52:10 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:10 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e" returned: 0 in 0.422s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:10 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654 Jul 19 17:52:10 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:10 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be759058-a3b2-4a4b-9463-76e553c54301" returned: 0 in 0.445s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be759058-a3b2-4a4b-9463-76e553c54301 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:11 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be759058-a3b2-4a4b-9463-76e553c54301 Jul 19 17:52:11 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:11 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654" returned: 0 in 0.497s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:11 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654 Jul 19 17:52:11 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:11 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-be759058-a3b2-4a4b-9463-76e553c54301" returned: 0 in 0.413s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-quobyte-be759058-a3b2-4a4b-9463-76e553c54301" released by "delete_volume" :: held 0.925s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:11 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e.c6a6c437-1b61-49b9-be22-56096baae654" returned: 0 in 0.313s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Created reservations ['384f9034-4021-421b-9c9f-d93afb567d24', '0fbea4ef-4831-4f26-9dac-cbdc00bd6d89', '48fea70f-edf4-46e6-9df7-c652728fca5e', '64d0bd8c-42fc-4417-b026-475c77152529'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-c6a6c437-1b61-49b9-be22-56096baae654" released by "_delete_snapshot" :: held 1.739s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-5c3406ed-3f00-48bb-8f02-6184e82f207e" released by "delete_snapshot" :: held 1.821s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] Creating offline snapshot a2903000-03b2-40ec-ae9b-3974a1a51fa4 of volume 88c2b5a5-c011-4b3b-a6cc-e9950b473bab {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce93ca8-a4d0-44ac-8ac0-311e0588270d]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Created reservations ['7cce6b91-367b-4a8d-b384-249bd0d391f2', '18ea492b-4f69-47a6-b6c2-efa8c3179ea6', 'a52a88ad-6e1d-4fb7-a3f4-4912c9bad264', '544d2209-bba1-407d-913b-a692d1df41fb'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:11 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:11 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:11 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab Jul 19 17:52:11 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:11 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Delete snapshot completed successfully. Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0fbb86fb-5786-454b-8208-a9a5855b6579 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-c6a6c437-1b61-49b9-be22-56096baae654-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:11 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-5c3406ed-3f00-48bb-8f02-6184e82f207e-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-5c3406ed-3f00-48bb-8f02-6184e82f207e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=242,cinder:UPDATE=315,cinder:INSERT=90,cinder:DELETE=30 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-quobyte-5c3406ed-3f00-48bb-8f02-6184e82f207e" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-5c3406ed-3f00-48bb-8f02-6184e82f207e" acquired by "delete_volume" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:12 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab" returned: 0 in 0.460s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e42d00-7002-4d13-9272-89bf035c6c99]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:12 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4 1G Jul 19 17:52:12 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:12 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.452s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:12 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Deleted volume successfully. Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cb82dbeb-3c41-4b5f-a0a1-f0c9ebf640f6 tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-be759058-a3b2-4a4b-9463-76e553c54301-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:12 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e Jul 19 17:52:12 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:12 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e" returned: 0 in 0.391s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:12 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e Jul 19 17:52:12 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:12 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4 1G" returned: 0 in 0.506s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "cinder-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:12 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4 Jul 19 17:52:12 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:UPDATE=333,cinder:SELECT=235,cinder:DELETE=27,cinder:INSERT=77 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "cinder-quobyte-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-quobyte-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[be59fcfd-1616-47ea-b7ff-4d22638e6234]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:12 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-5c3406ed-3f00-48bb-8f02-6184e82f207e" returned: 0 in 0.319s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-5c3406ed-3f00-48bb-8f02-6184e82f207e" released by "delete_volume" :: held 0.789s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Created reservations ['82270dd9-a4af-4eaf-97df-dec7a35b8067', '935b9a81-685f-4049-8d5f-64fb37955038', '8e2b2d4e-8077-402b-9ef1-55e643934e9b', '3c3d6c26-5644-457a-b71f-2d3fdc069c99'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:12 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c Jul 19 17:52:12 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:12 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4" returned: 0 in 0.357s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:12 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4 is being set with open permissions: ugo+rw Jul 19 17:52:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:13 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4 Jul 19 17:52:13 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:13 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:13 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:13 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c" returned: 0 in 0.557s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:13 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c Jul 19 17:52:13 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:13 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.378s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:13 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Deleted volume successfully. Jul 19 17:52:13 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4" returned: 0 in 0.486s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-057b6c46-b1b9-46b3-a92c-4f6a2cd22da9 tempest-ProjectReaderTests-1730663272 None] Lock "cinder-5c3406ed-3f00-48bb-8f02-6184e82f207e-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:13 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.info Jul 19 17:52:13 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:13 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c" returned: 0 in 0.341s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-quobyte-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c" released by "delete_volume" :: held 0.953s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Created reservations ['c81139af-b761-4bcd-bb9f-06e47335d97d', '0812f367-d73e-42f9-9527-1ea244147b80', 'd6d1aa16-5c26-44be-87a3-d8a8a69898dd', '5eb0d971-cee8-40d9-85fa-92bbb026aefc'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:13 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.info" returned: 0 in 0.356s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:13 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.info is being set with open permissions: ugo+rw Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:13 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:13 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:13 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.info Jul 19 17:52:13 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Flow 'volume_create_manager' (33b51bf1-9be3-4ce2-baa9-6bcd5b9f9002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:13 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a77c88-1d50-4146-98db-4a36389f0dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a77c88-1d50-4146-98db-4a36389f0dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-792441807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec37345-ec93-437d-8574-c603f0a6211b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e059d676114b799ce92d9545b79b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:14Z,use_quota=True,user_id='b379d3427ced404ca91a667c316f6239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d2303e-6ffd-446c-8cfa-082a45dd6083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d2303e-6ffd-446c-8cfa-082a45dd6083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07109d91-e94d-4326-ad3e-b554b8cab006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07109d91-e94d-4326-ad3e-b554b8cab006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ec37345-ec93-437d-8574-c603f0a6211b', 'volume_name': 'volume-8ec37345-ec93-437d-8574-c603f0a6211b', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1125ed36-a526-4b40-a6b3-54ca09b5e301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1125ed36-a526-4b40-a6b3-54ca09b5e301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86840a6d-b60d-4a62-9628-6aabeb6ac94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:14 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Volume 8ec37345-ec93-437d-8574-c603f0a6211b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ec37345-ec93-437d-8574-c603f0a6211b', 'volume_size': 1} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:14 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.253s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Deleted volume successfully. Jul 19 17:52:14 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.info" returned: 0 in 0.279s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.632s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ff5ea331-0192-4fab-9c4f-8de596889a1a tempest-CreateVolumesFromSourceVolumeTest-1686958362 None] Lock "cinder-093d2b0e-3aa8-4e4a-b0cc-ec244fd6a09c-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.165s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-792441807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec37345-ec93-437d-8574-c603f0a6211b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e059d676114b799ce92d9545b79b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:14Z,use_quota=True,user_id='b379d3427ced404ca91a667c316f6239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Creating volume 8ec37345-ec93-437d-8574-c603f0a6211b {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:14 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:14 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b 1073741824 Jul 19 17:52:14 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-1969e43c-8b6d-4414-b5df-5c4453ec05ea tempest-ProjectMemberTests-1812963129 None] Create snapshot completed successfully Jul 19 17:52:14 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b 1073741824" returned: 0 in 0.439s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:14 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b Jul 19 17:52:14 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-a2903000-03b2-40ec-ae9b-3974a1a51fa4-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-a2903000-03b2-40ec-ae9b-3974a1a51fa4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-88c2b5a5-c011-4b3b-a6cc-e9950b473bab" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-88c2b5a5-c011-4b3b-a6cc-e9950b473bab" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-a2903000-03b2-40ec-ae9b-3974a1a51fa4" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-a2903000-03b2-40ec-ae9b-3974a1a51fa4" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Deleting offline snapshot a2903000-03b2-40ec-ae9b-3974a1a51fa4 of volume 88c2b5a5-c011-4b3b-a6cc-e9950b473bab {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] snapshot_file for this snap is: volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b49251-8ede-44dd-a8af-4cc763fb7083]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:14 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4 Jul 19 17:52:14 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:15 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b" returned: 0 in 0.411s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86840a6d-b60d-4a62-9628-6aabeb6ac94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec37345-ec93-437d-8574-c603f0a6211b', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef51dcf-20a2-4bb3-8cc4-0829248001c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:15 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Volume volume-8ec37345-ec93-437d-8574-c603f0a6211b (8ec37345-ec93-437d-8574-c603f0a6211b): created successfully Jul 19 17:52:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef51dcf-20a2-4bb3-8cc4-0829248001c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Flow 'volume_create_manager' (33b51bf1-9be3-4ce2-baa9-6bcd5b9f9002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:15 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-72638846-3f34-447a-b65e-c2c32bbe0fcc tempest-ProjectReaderTests-1730663272 None] Created volume successfully. Jul 19 17:52:15 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4" returned: 0 in 0.426s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:15 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:52:15 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2680e5d-a055-47a1-98cf-1f9a2895f2dc]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:15 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab Jul 19 17:52:15 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:15 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab" returned: 0 in 0.395s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:15 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4 Jul 19 17:52:15 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:16 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4" returned: 0 in 0.419s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:16 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4 Jul 19 17:52:16 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] Creating offline snapshot e5a5ab71-de47-4bf5-bc3a-e132e2539b21 of volume 8ec37345-ec93-437d-8574-c603f0a6211b {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:52:16 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beeb613-0675-4c4d-b601-d0f01522381e]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:16 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b Jul 19 17:52:16 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:16 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab.a2903000-03b2-40ec-ae9b-3974a1a51fa4" returned: 0 in 0.309s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:16 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-a2903000-03b2-40ec-ae9b-3974a1a51fa4" released by "_delete_snapshot" :: held 1.704s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:16 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-88c2b5a5-c011-4b3b-a6cc-e9950b473bab" released by "delete_snapshot" :: held 1.745s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:16 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Created reservations ['283a2865-0f5f-4edd-a78a-45324d27c1c3', '71cd7dde-a9b7-4d83-b571-d33c0eaffea4', 'f9191656-065f-477c-b392-5b3ee7fdb7ca', '36d1c039-ff3a-4402-8ff4-20bc48cf5336'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:16 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Delete snapshot completed successfully. Jul 19 17:52:16 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-6f8a67f5-a788-4de0-b443-0c632c6ff341 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-a2903000-03b2-40ec-ae9b-3974a1a51fa4-delete_snapshot" released by "delete_snapshot" :: held 1.950s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:16 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b" returned: 0 in 0.476s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:16 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21 1G Jul 19 17:52:16 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:16 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-88c2b5a5-c011-4b3b-a6cc-e9950b473bab-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:16 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Lock "cinder-88c2b5a5-c011-4b3b-a6cc-e9950b473bab-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:17 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-88c2b5a5-c011-4b3b-a6cc-e9950b473bab" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:17 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-88c2b5a5-c011-4b3b-a6cc-e9950b473bab" acquired by "delete_volume" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:17 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a241fb-633c-4dd9-9bc5-870e509f4a3e]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:17 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab Jul 19 17:52:17 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:17 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21 1G" returned: 0 in 0.581s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ec37345-ec93-437d-8574-c603f0a6211b -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:17 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ec37345-ec93-437d-8574-c603f0a6211b -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21 Jul 19 17:52:17 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:17 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab" returned: 0 in 0.498s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:17 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab Jul 19 17:52:17 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:17 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ec37345-ec93-437d-8574-c603f0a6211b -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21" returned: 0 in 0.393s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:17 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21 is being set with open permissions: ugo+rw Jul 19 17:52:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:17 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21 Jul 19 17:52:17 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:17 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-88c2b5a5-c011-4b3b-a6cc-e9950b473bab" returned: 0 in 0.267s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:17 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-88c2b5a5-c011-4b3b-a6cc-e9950b473bab" released by "delete_volume" :: held 0.852s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:17 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Created reservations ['cae109e1-0d3d-4d1e-8497-0a2fb8247fc7', 'd9431845-1a6f-4cfb-bdea-ad3e92e00f3b', '72a625ba-5705-4e78-bcd1-10b29cda709f', '7e9e3df2-6509-4a77-b74b-e6b84cbd6af6'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:17 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21" returned: 0 in 0.265s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:17 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:18 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.info Jul 19 17:52:18 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:18 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:18 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:18 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.info" returned: 0 in 0.357s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:18 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.info is being set with open permissions: ugo+rw Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:18 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.info Jul 19 17:52:18 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:18 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.348s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:18 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Deleted volume successfully. Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-03dcb83d-d16e-4eb6-ac2f-c1fe4a5d62bd tempest-ProjectMemberTests-1812963129 None] Lock "cinder-88c2b5a5-c011-4b3b-a6cc-e9950b473bab-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:18 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.info" returned: 0 in 0.329s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.509s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:18 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-15947690-5ae3-4e03-bf02-e265d3f5edd3 tempest-ProjectReaderTests-1730663272 None] Create snapshot completed successfully Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (7041a740-1c50-407a-9749-f808d4c5b3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510a1801-b6ce-473b-98d5-e5fa3d30ad29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510a1801-b6ce-473b-98d5-e5fa3d30ad29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1872785713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb835f83-7a45-4f27-ac82-020766096dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:19Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf6bfab-76c5-4cdb-9072-b00fbed1bb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf6bfab-76c5-4cdb-9072-b00fbed1bb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d991b333-92a5-41c6-9772-2ea3635d7d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d991b333-92a5-41c6-9772-2ea3635d7d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb835f83-7a45-4f27-ac82-020766096dd5', 'volume_name': 'volume-cb835f83-7a45-4f27-ac82-020766096dd5', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (589aec4b-b74c-4777-8654-ef75eaae299f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (589aec4b-b74c-4777-8654-ef75eaae299f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0d44b0-debe-47d3-a07b-7d2d2340fda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:18 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Volume cb835f83-7a45-4f27-ac82-020766096dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb835f83-7a45-4f27-ac82-020766096dd5', 'volume_size': 1} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1872785713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb835f83-7a45-4f27-ac82-020766096dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:19Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Creating volume cb835f83-7a45-4f27-ac82-020766096dd5 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:18 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:18 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:18 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5 1073741824 Jul 19 17:52:18 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-e5a5ab71-de47-4bf5-bc3a-e132e2539b21-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Lock "cinder-e5a5ab71-de47-4bf5-bc3a-e132e2539b21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-quobyte-8ec37345-ec93-437d-8574-c603f0a6211b" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:19 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5 1073741824" returned: 0 in 0.591s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-8ec37345-ec93-437d-8574-c603f0a6211b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-quobyte-e5a5ab71-de47-4bf5-bc3a-e132e2539b21" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-e5a5ab71-de47-4bf5-bc3a-e132e2539b21" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Deleting offline snapshot e5a5ab71-de47-4bf5-bc3a-e132e2539b21 of volume 8ec37345-ec93-437d-8574-c603f0a6211b {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] snapshot_file for this snap is: volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d02db43-c891-4a5e-8ca7-e7fb9ffc0388]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:19 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5 Jul 19 17:52:19 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:19 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21 Jul 19 17:52:19 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:19 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5" returned: 0 in 0.285s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0d44b0-debe-47d3-a07b-7d2d2340fda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb835f83-7a45-4f27-ac82-020766096dd5', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed20559d-3fd7-438a-9ee6-603b52a56739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:19 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Volume volume-cb835f83-7a45-4f27-ac82-020766096dd5 (cb835f83-7a45-4f27-ac82-020766096dd5): created successfully Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed20559d-3fd7-438a-9ee6-603b52a56739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:19 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (7041a740-1c50-407a-9749-f808d4c5b3d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:19 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-83b54484-97c0-458d-a20e-df65a1875fff tempest-ProjectMemberTests-1812963129 None] Created volume successfully. Jul 19 17:52:20 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21" returned: 0 in 0.495s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:20 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ec37345-ec93-437d-8574-c603f0a6211b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:52:20 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb9b77c-92a4-4182-93ae-f9dcb38ccd23]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:20 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b Jul 19 17:52:20 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:20 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b" returned: 0 in 0.422s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:20 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21 Jul 19 17:52:20 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:20 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21" returned: 0 in 0.446s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:20 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:21 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21 Jul 19 17:52:21 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] Creating offline snapshot 01990176-6264-421b-be0b-7a6c70149178 of volume cb835f83-7a45-4f27-ac82-020766096dd5 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e0d345-8b5f-4274-94ab-2975f4881fcb]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:21 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5 Jul 19 17:52:21 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:21 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b.e5a5ab71-de47-4bf5-bc3a-e132e2539b21" returned: 0 in 0.383s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-e5a5ab71-de47-4bf5-bc3a-e132e2539b21" released by "_delete_snapshot" :: held 1.869s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-8ec37345-ec93-437d-8574-c603f0a6211b" released by "delete_snapshot" :: held 1.919s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Flow 'volume_create_manager' (7267d433-141e-45cb-bfc3-88a81426bffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9001eaa-1706-4c78-bbbe-12da8c728e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9001eaa-1706-4c78-bbbe-12da8c728e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3acb9e-4679-4784-b1b2-5f88ed207b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1342df3152d44c4908c2fbddac5f64b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:21Z,use_quota=True,user_id='81001b63730a42b1a11b47a1bcc507f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c503f6-ce12-47dc-b24b-5465961d5690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c503f6-ce12-47dc-b24b-5465961d5690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cef4433-a630-485a-9c2f-6e7d1511ad22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.image.glance [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Creating Keystone auth plugin from conf {{(pid=87676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 19 17:52:21 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5" returned: 0 in 0.437s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Created reservations ['32d47cbe-0067-4896-b240-ffb0a066641b', '6a3bbc81-2cb0-486a-ae85-6e5e2ac51706', '0cb3e5ca-ac36-465b-8ab8-ecb0b7bdf91d', '77c27c42-84d9-4de7-b0ba-ff546fc01b72'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:21 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178 1G Jul 19 17:52:21 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:21 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Delete snapshot completed successfully. Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9928ff6b-c2d4-4047-ad08-caeab2056afa tempest-ProjectReaderTests-1730663272 None] Lock "cinder-e5a5ab71-de47-4bf5-bc3a-e132e2539b21-delete_snapshot" released by "delete_snapshot" :: held 2.195s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cef4433-a630-485a-9c2f-6e7d1511ad22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4c3acb9e-4679-4784-b1b2-5f88ed207b6c', 'volume_name': 'volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c', 'volume_size': 1, 'image_id': '9757f89a-b6ef-4b79-96d3-cce9a44fb7b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9757f89a-b6ef-4b79-96d3-cce9a44fb7b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '635a503e53c7a94587cccf28bdb146d8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1342df3152d44c4908c2fbddac5f64b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb8e6c605435ce45ca74d67c95f69ec1390b67301f7178732b39f6a97b0aa3975330d273764a2d183a177f6e34145ecac409ffa80371f73bb28206c3de9a46a5', 'id': '9757f89a-b6ef-4b79-96d3-cce9a44fb7b1', 'created_at': datetime.datetime(2026, 7, 19, 15, 52, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 52, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9757f89a-b6ef-4b79-96d3-cce9a44fb7b1/file', 'properties': {}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff99ef97-1384-4f01-9e59-c16fdcf5f134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff99ef97-1384-4f01-9e59-c16fdcf5f134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6606d095-7727-4e80-85f6-4c2e015c09ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:21 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Volume 4c3acb9e-4679-4784-b1b2-5f88ed207b6c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c', 'volume_size': 1, 'image_id': '9757f89a-b6ef-4b79-96d3-cce9a44fb7b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9757f89a-b6ef-4b79-96d3-cce9a44fb7b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '635a503e53c7a94587cccf28bdb146d8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1342df3152d44c4908c2fbddac5f64b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb8e6c605435ce45ca74d67c95f69ec1390b67301f7178732b39f6a97b0aa3975330d273764a2d183a177f6e34145ecac409ffa80371f73bb28206c3de9a46a5', 'id': '9757f89a-b6ef-4b79-96d3-cce9a44fb7b1', 'created_at': datetime.datetime(2026, 7, 19, 15, 52, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 52, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9757f89a-b6ef-4b79-96d3-cce9a44fb7b1/file', 'properties': {}}, 'image_service': } Jul 19 17:52:21 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Trying to clone 4c3acb9e-4679-4784-b1b2-5f88ed207b6c from image 9757f89a-b6ef-4b79-96d3-cce9a44fb7b1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9757f89a-b6ef-4b79-96d3-cce9a44fb7b1', 'metadata': {}}]). {{(pid=87676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 19 17:52:22 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178 1G" returned: 0 in 0.484s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb835f83-7a45-4f27-ac82-020766096dd5 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:22 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb835f83-7a45-4f27-ac82-020766096dd5 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178 Jul 19 17:52:22 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 19 17:52:22 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Image download 0.00 MB at 0.00 MB/s Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[23980cc5-203f-436b-af8c-92ec6430163c]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:22 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD Jul 19 17:52:22 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:22 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb835f83-7a45-4f27-ac82-020766096dd5 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178" returned: 0 in 0.333s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:22 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178 is being set with open permissions: ugo+rw Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:22 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178 Jul 19 17:52:22 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:22 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:22 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178" returned: 0 in 0.282s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-8ec37345-ec93-437d-8574-c603f0a6211b-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Lock "cinder-8ec37345-ec93-437d-8574-c603f0a6211b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:22 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD Jul 19 17:52:22 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:22 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.info Jul 19 17:52:22 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Acquiring lock "cinder-quobyte-8ec37345-ec93-437d-8574-c603f0a6211b" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-8ec37345-ec93-437d-8574-c603f0a6211b" acquired by "delete_volume" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5f30f0-542e-43d0-aab8-96f3633c5a73]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:22 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD" returned: 1 in 0.383s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:52:22 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Temporary image 9757f89a-b6ef-4b79-96d3-cce9a44fb7b1 is fetched for user 81001b63730a42b1a11b47a1bcc507f7. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 19 17:52:22 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b Jul 19 17:52:22 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3fc631-6b09-41fe-aac7-21b699288a60]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:23 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.info" returned: 0 in 0.362s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:23 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.info is being set with open permissions: ugo+rw Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:23 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.info Jul 19 17:52:23 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:23 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD Jul 19 17:52:23 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:23 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b" returned: 0 in 0.552s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:23 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.info" returned: 0 in 0.343s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:23 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b Jul 19 17:52:23 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.398s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:23 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD" returned: 0 in 0.449s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:23 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-34bf0e89-ab63-4f38-8168-fdc9f1a4d65d tempest-ProjectMemberTests-1812963129 None] Create snapshot completed successfully Jul 19 17:52:23 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD Jul 19 17:52:23 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:23 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8ec37345-ec93-437d-8574-c603f0a6211b" returned: 0 in 0.281s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Lock "cinder-quobyte-8ec37345-ec93-437d-8574-c603f0a6211b" released by "delete_volume" :: held 0.904s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Created reservations ['4f52f265-0a48-48a6-85a6-d623af881fcb', '8eb880bb-2188-46f3-891b-79153c8c2c5d', 'fa7e85f1-d92c-4c03-8c3e-f95aa6b91d40', 'be558825-08c7-4be4-a2e8-b587d55b32d9'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:23 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD" returned: 1 in 0.369s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3acb9e-4679-4784-b1b2-5f88ed207b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1342df3152d44c4908c2fbddac5f64b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:21Z,use_quota=True,user_id='81001b63730a42b1a11b47a1bcc507f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Creating volume 4c3acb9e-4679-4784-b1b2-5f88ed207b6c {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:23 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:23 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:23 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:23 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c 1073741824 Jul 19 17:52:23 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:24 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.264s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:24 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Deleted volume successfully. Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-ba6f360d-b7d8-4418-a78b-5d429f2546bd tempest-ProjectReaderTests-1730663272 None] Lock "cinder-8ec37345-ec93-437d-8574-c603f0a6211b-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-01990176-6264-421b-be0b-7a6c70149178-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Lock "cinder-01990176-6264-421b-be0b-7a6c70149178-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-cb835f83-7a45-4f27-ac82-020766096dd5" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-cb835f83-7a45-4f27-ac82-020766096dd5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-01990176-6264-421b-be0b-7a6c70149178" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-01990176-6264-421b-be0b-7a6c70149178" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Deleting offline snapshot 01990176-6264-421b-be0b-7a6c70149178 of volume cb835f83-7a45-4f27-ac82-020766096dd5 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] snapshot_file for this snap is: volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[280dd69d-0ada-42b2-b15d-f1da1e72df5e]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:24 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c 1073741824" returned: 0 in 0.513s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:24 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178 Jul 19 17:52:24 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:24 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c Jul 19 17:52:24 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:24 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c" returned: 0 in 0.264s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:24 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178" returned: 0 in 0.418s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb835f83-7a45-4f27-ac82-020766096dd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c27156-fced-4f7b-8f11-9140cf9c56e9]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Attempting download of 9757f89a-b6ef-4b79-96d3-cce9a44fb7b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9757f89a-b6ef-4b79-96d3-cce9a44fb7b1', 'metadata': {}}])) to volume 4c3acb9e-4679-4784-b1b2-5f88ed207b6c. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[78000b27-bd21-499f-ae4b-633aa06d91d2]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_hg8xxr6c {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:24 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5 Jul 19 17:52:24 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:24 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_hg8xxr6c Jul 19 17:52:24 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:25 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5" returned: 0 in 0.418s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:25 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178 Jul 19 17:52:25 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:25 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_hg8xxr6c" returned: 0 in 0.400s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_hg8xxr6c {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:25 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_hg8xxr6c Jul 19 17:52:25 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:25 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_hg8xxr6c" returned: 1 in 0.392s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_hg8xxr6c' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:52:25 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda08eab-40bd-407e-bf6d-338465e60fed]: (4, 'raw') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:25 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178" returned: 0 in 0.513s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:25 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178 Jul 19 17:52:25 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:25 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD Jul 19 17:52:25 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:25 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5.01990176-6264-421b-be0b-7a6c70149178" returned: 0 in 0.261s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:25 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-01990176-6264-421b-be0b-7a6c70149178" released by "_delete_snapshot" :: held 1.747s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-cb835f83-7a45-4f27-ac82-020766096dd5" released by "delete_snapshot" :: held 1.776s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Created reservations ['bad81a46-6f08-41fb-a162-8fe4f47192dd', 'e22a13f0-8c3f-4d69-a8c8-d75548c4afaa', '3dd9f1cf-46e8-4369-a7bd-d2129275c5e2', 'ac9139a4-b9b5-41a7-b03f-2733558dfc7d'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:26 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD Jul 19 17:52:26 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:26 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Delete snapshot completed successfully. Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-a653cd28-939c-4f5d-baec-5b07204e9bec tempest-ProjectMemberTests-1812963129 None] Lock "cinder-01990176-6264-421b-be0b-7a6c70149178-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:26 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD" returned: 1 in 0.383s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] 9757f89a-b6ef-4b79-96d3-cce9a44fb7b1 was raw, converting to qcow2 {{(pid=87676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:26 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c Jul 19 17:52:26 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-cb835f83-7a45-4f27-ac82-020766096dd5-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-cb835f83-7a45-4f27-ac82-020766096dd5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-cb835f83-7a45-4f27-ac82-020766096dd5" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-cb835f83-7a45-4f27-ac82-020766096dd5" acquired by "delete_volume" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b36e230-d3f6-4474-b014-370d07cc9d02]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:26 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5 Jul 19 17:52:26 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:26 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c" returned: 0 in 0.569s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9757f89a-b6ef-4b79-96d3-cce9a44fb7b1_3i8pb5t_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:52:26 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Converted 0.00 MB image at 0.00 MB/s Jul 19 17:52:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:26 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c 1G Jul 19 17:52:26 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:27 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5" returned: 0 in 0.517s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:27 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5 Jul 19 17:52:27 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:27 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c 1G" returned: 0 in 0.434s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Downloaded image 9757f89a-b6ef-4b79-96d3-cce9a44fb7b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9757f89a-b6ef-4b79-96d3-cce9a44fb7b1', 'metadata': {}}])) to volume 4c3acb9e-4679-4784-b1b2-5f88ed207b6c successfully. {{(pid=87676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Temporary image 9757f89a-b6ef-4b79-96d3-cce9a44fb7b1 for user 81001b63730a42b1a11b47a1bcc507f7 is deleted. {{(pid=87676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.volume.volume_utils [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Marking volume 4c3acb9e-4679-4784-b1b2-5f88ed207b6c as bootable. {{(pid=87676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Copying metadata from image 9757f89a-b6ef-4b79-96d3-cce9a44fb7b1 to 4c3acb9e-4679-4784-b1b2-5f88ed207b6c. {{(pid=87676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Creating volume glance metadata for volume 4c3acb9e-4679-4784-b1b2-5f88ed207b6c backed by image 9757f89a-b6ef-4b79-96d3-cce9a44fb7b1 with: {'image_id': '9757f89a-b6ef-4b79-96d3-cce9a44fb7b1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '635a503e53c7a94587cccf28bdb146d8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 19 17:52:27 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-cb835f83-7a45-4f27-ac82-020766096dd5" returned: 0 in 0.310s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-cb835f83-7a45-4f27-ac82-020766096dd5" released by "delete_volume" :: held 0.925s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6606d095-7727-4e80-85f6-4c2e015c09ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c', 'volume_size': 1, 'image_id': '9757f89a-b6ef-4b79-96d3-cce9a44fb7b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9757f89a-b6ef-4b79-96d3-cce9a44fb7b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '635a503e53c7a94587cccf28bdb146d8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1342df3152d44c4908c2fbddac5f64b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb8e6c605435ce45ca74d67c95f69ec1390b67301f7178732b39f6a97b0aa3975330d273764a2d183a177f6e34145ecac409ffa80371f73bb28206c3de9a46a5', 'id': '9757f89a-b6ef-4b79-96d3-cce9a44fb7b1', 'created_at': datetime.datetime(2026, 7, 19, 15, 52, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 15, 52, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9757f89a-b6ef-4b79-96d3-cce9a44fb7b1/file', 'properties': {}}, 'image_service': }' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0b65c6-b2f9-402e-9cfe-35e46f63067f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:27 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Volume volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c (4c3acb9e-4679-4784-b1b2-5f88ed207b6c): created successfully Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0b65c6-b2f9-402e-9cfe-35e46f63067f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Flow 'volume_create_manager' (7267d433-141e-45cb-bfc3-88a81426bffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:27 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c7bd3136-9649-4b7e-a3cb-f7fdffcef6b6 tempest-VolumeImageDependencyTests-1633956037 None] Created volume successfully. Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Created reservations ['b7c35743-e153-4a6d-8dff-d73238945a35', 'e4806d38-b27b-4ae3-86ba-48269da7d552', '1a78956e-02b3-4ea4-8ceb-403cd103bd04', '9c659f93-cddc-4c2d-a04f-c4a65663c397'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:27 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:27 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Acquiring lock "cinder-4c3acb9e-4679-4784-b1b2-5f88ed207b6c-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Lock "cinder-4c3acb9e-4679-4784-b1b2-5f88ed207b6c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Acquiring lock "cinder-quobyte-4c3acb9e-4679-4784-b1b2-5f88ed207b6c" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Lock "cinder-quobyte-4c3acb9e-4679-4784-b1b2-5f88ed207b6c" acquired by "delete_volume" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:27 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.268s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:28 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:28 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Deleted volume successfully. Jul 19 17:52:28 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[693e4733-5f5d-4b77-9697-b0e2544c1d68]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-389c82b0-a409-432b-af9f-c2260d4a4453 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-cb835f83-7a45-4f27-ac82-020766096dd5-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:28 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c Jul 19 17:52:28 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:28 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c" returned: 0 in 0.410s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:28 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c Jul 19 17:52:28 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:28 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c3acb9e-4679-4784-b1b2-5f88ed207b6c" returned: 0 in 0.297s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Lock "cinder-quobyte-4c3acb9e-4679-4784-b1b2-5f88ed207b6c" released by "delete_volume" :: held 0.767s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:28 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Created reservations ['baf5e5ae-ff94-4d2a-bd8c-96dcc88f5651', 'ee63d18b-cff7-42dd-90f4-006787850448', '8b381f4f-9197-49a4-91e2-87c624affcc5', 'ee9cc5b0-d118-48cc-9303-177086fd8156'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:28 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:28 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:28 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:29 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.392s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:29 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Deleted volume successfully. Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (b9d0c89b-2fc3-4af8-ae6f-598041b6b1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92eb89b-5f64-40fa-a4c6-797eb7b303cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-50f7a817-262a-4f9b-b5a8-20c70c56f341 tempest-VolumeImageDependencyTests-1633956037 None] Lock "cinder-4c3acb9e-4679-4784-b1b2-5f88ed207b6c-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92eb89b-5f64-40fa-a4c6-797eb7b303cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115055829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a3b7ed-4612-41d0-bb1f-6d0e34635014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:29Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d245d5f5-a70d-4f18-9475-81cfa11bdaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d245d5f5-a70d-4f18-9475-81cfa11bdaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67abac53-72ac-4db6-bf18-6fd5ffe81101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67abac53-72ac-4db6-bf18-6fd5ffe81101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a3b7ed-4612-41d0-bb1f-6d0e34635014', 'volume_name': 'volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e4fb77-5994-47aa-a8d9-74bf9b47e691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e4fb77-5994-47aa-a8d9-74bf9b47e691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe52f08-c98a-4d8f-9c43-411fc75326cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:29 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Volume d2a3b7ed-4612-41d0-bb1f-6d0e34635014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014', 'volume_size': 1} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115055829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a3b7ed-4612-41d0-bb1f-6d0e34635014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:29Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Creating volume d2a3b7ed-4612-41d0-bb1f-6d0e34635014 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:29 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:29 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 1073741824 Jul 19 17:52:29 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Flow 'volume_create_manager' (d73bb4a8-6fa8-4e98-b53c-34ee03fc8e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b90a5b1-49e4-4293-b8b3-c709d6b27e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b90a5b1-49e4-4293-b8b3-c709d6b27e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259417493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c69f2d2-9da0-4c59-a62f-c07411e3bd67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ef3497eea74d49a43978eda2ab7dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:30Z,use_quota=True,user_id='7726e372205841308d3ef56562ea3e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a43c6b-e754-4065-9fcd-2e3f02ebea1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a43c6b-e754-4065-9fcd-2e3f02ebea1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6692ee-2c82-4df7-9662-2445e2915a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6692ee-2c82-4df7-9662-2445e2915a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c69f2d2-9da0-4c59-a62f-c07411e3bd67', 'volume_name': 'volume-6c69f2d2-9da0-4c59-a62f-c07411e3bd67', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43d0d26-74ca-4ad9-954a-10c57280d6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43d0d26-74ca-4ad9-954a-10c57280d6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e72050f-c619-4ff2-aee3-0f674d721801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:29 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Volume 6c69f2d2-9da0-4c59-a62f-c07411e3bd67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c69f2d2-9da0-4c59-a62f-c07411e3bd67', 'volume_size': 1} Jul 19 17:52:29 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:30 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 1073741824" returned: 0 in 0.608s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:30 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 Jul 19 17:52:30 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:30 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014" returned: 0 in 0.315s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.563s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259417493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c69f2d2-9da0-4c59-a62f-c07411e3bd67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ef3497eea74d49a43978eda2ab7dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:30Z,use_quota=True,user_id='7726e372205841308d3ef56562ea3e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Creating volume 6c69f2d2-9da0-4c59-a62f-c07411e3bd67 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:30 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c69f2d2-9da0-4c59-a62f-c07411e3bd67 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:30 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c69f2d2-9da0-4c59-a62f-c07411e3bd67 1073741824 Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe52f08-c98a-4d8f-9c43-411fc75326cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:30 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8090b2-4c32-46eb-888c-e1f16e49d31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:30 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Volume volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 (d2a3b7ed-4612-41d0-bb1f-6d0e34635014): created successfully Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8090b2-4c32-46eb-888c-e1f16e49d31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:30 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (b9d0c89b-2fc3-4af8-ae6f-598041b6b1dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:30 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-4cfd4b9b-32e9-45a1-91fc-88c2768ba78a tempest-ProjectMemberTests-1812963129 None] Created volume successfully. Jul 19 17:52:31 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c69f2d2-9da0-4c59-a62f-c07411e3bd67 1073741824" returned: 0 in 0.570s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c69f2d2-9da0-4c59-a62f-c07411e3bd67 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:31 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c69f2d2-9da0-4c59-a62f-c07411e3bd67 Jul 19 17:52:31 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:31 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c69f2d2-9da0-4c59-a62f-c07411e3bd67" returned: 0 in 0.304s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e72050f-c619-4ff2-aee3-0f674d721801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c69f2d2-9da0-4c59-a62f-c07411e3bd67', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc995db-1927-4324-bff1-b4279854144a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:31 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Volume volume-6c69f2d2-9da0-4c59-a62f-c07411e3bd67 (6c69f2d2-9da0-4c59-a62f-c07411e3bd67): created successfully Jul 19 17:52:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc995db-1927-4324-bff1-b4279854144a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:31 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Flow 'volume_create_manager' (d73bb4a8-6fa8-4e98-b53c-34ee03fc8e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:31 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-459e7255-5901-4be7-9d66-099a5dd79420 tempest-ProjectReaderTests-1648104976 None] Created volume successfully. Jul 19 17:52:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:31 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] Creating offline snapshot cf530db9-561a-4813-b1e8-6c71daa6c5eb of volume d2a3b7ed-4612-41d0-bb1f-6d0e34635014 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:52:31 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2192a63c-0204-4cfb-86cb-fd8969d93df5]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:31 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:31 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 Jul 19 17:52:31 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:32 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014" returned: 0 in 0.443s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:32 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb 1G Jul 19 17:52:32 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Acquiring lock "cinder-6c69f2d2-9da0-4c59-a62f-c07411e3bd67-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Lock "cinder-6c69f2d2-9da0-4c59-a62f-c07411e3bd67-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Acquiring lock "cinder-quobyte-6c69f2d2-9da0-4c59-a62f-c07411e3bd67" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Lock "cinder-quobyte-6c69f2d2-9da0-4c59-a62f-c07411e3bd67" acquired by "delete_volume" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:32 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14a6570-5f9c-4f81-88ed-87626a69d36d]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c69f2d2-9da0-4c59-a62f-c07411e3bd67 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:32 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c69f2d2-9da0-4c59-a62f-c07411e3bd67 Jul 19 17:52:32 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:32 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb 1G" returned: 0 in 0.602s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:32 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb Jul 19 17:52:32 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:32 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c69f2d2-9da0-4c59-a62f-c07411e3bd67" returned: 0 in 0.460s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c69f2d2-9da0-4c59-a62f-c07411e3bd67 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:33 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c69f2d2-9da0-4c59-a62f-c07411e3bd67 Jul 19 17:52:33 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:33 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb" returned: 0 in 0.392s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:33 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb is being set with open permissions: ugo+rw Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:33 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb Jul 19 17:52:33 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:33 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-6c69f2d2-9da0-4c59-a62f-c07411e3bd67" returned: 0 in 0.317s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Lock "cinder-quobyte-6c69f2d2-9da0-4c59-a62f-c07411e3bd67" released by "delete_volume" :: held 0.831s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Created reservations ['b1b916ad-b8ff-4afc-a2d5-f1e6dd18e890', '5a535376-6e45-4eec-ac2b-3c1dea897126', '4d0cfcd6-4754-485e-8941-67ab4d5c3f35', '357714f9-7a62-4235-8d55-6f294094540b'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:33 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb" returned: 0 in 0.336s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:33 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:33 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:33 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.info Jul 19 17:52:33 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-f6962ce7-c9d0-4290-ba3f-202f9b2753f6 tempest-ProjectAdminTests-920128190 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87676) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 19 17:52:33 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.338s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:33 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Deleted volume successfully. Jul 19 17:52:33 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.info" returned: 0 in 0.302s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:33 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.info is being set with open permissions: ugo+rw Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:33 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-7867e0da-0a3a-4a65-9042-62693fc593eb tempest-ProjectReaderTests-1648104976 None] Lock "cinder-6c69f2d2-9da0-4c59-a62f-c07411e3bd67-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:33 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.info Jul 19 17:52:33 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:34 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.info" returned: 0 in 0.434s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:34 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-fd940877-f1a4-4b2e-91eb-ecbc167ecb73 tempest-ProjectMemberTests-1812963129 None] Create snapshot completed successfully Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Flow 'volume_create_manager' (ff78e172-397f-4aa1-afc1-26b934d5de91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672bc3ee-1e26-4dbb-8228-ee24dc9f2e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672bc3ee-1e26-4dbb-8228-ee24dc9f2e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1852869541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896b6824-c7db-4423-a66b-2cb223c56511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ef3497eea74d49a43978eda2ab7dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:34Z,use_quota=True,user_id='7726e372205841308d3ef56562ea3e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5f426b-b98e-4f4e-a521-aa8d430f8e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5f426b-b98e-4f4e-a521-aa8d430f8e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c35876f-4920-42ef-8ffd-e20ee5321500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c35876f-4920-42ef-8ffd-e20ee5321500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '896b6824-c7db-4423-a66b-2cb223c56511', 'volume_name': 'volume-896b6824-c7db-4423-a66b-2cb223c56511', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acaf55c6-de11-4d74-b5f1-5e8ba898ae22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acaf55c6-de11-4d74-b5f1-5e8ba898ae22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4132ca8-e82c-4a1c-aa6b-03c4e933bc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:34 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Volume 896b6824-c7db-4423-a66b-2cb223c56511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-896b6824-c7db-4423-a66b-2cb223c56511', 'volume_size': 1} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1852869541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896b6824-c7db-4423-a66b-2cb223c56511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ef3497eea74d49a43978eda2ab7dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:34Z,use_quota=True,user_id='7726e372205841308d3ef56562ea3e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Creating volume 896b6824-c7db-4423-a66b-2cb223c56511 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:34 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-896b6824-c7db-4423-a66b-2cb223c56511 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:34 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-896b6824-c7db-4423-a66b-2cb223c56511 1073741824 Jul 19 17:52:34 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:34 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-896b6824-c7db-4423-a66b-2cb223c56511 1073741824" returned: 0 in 0.439s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:35 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:35 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-896b6824-c7db-4423-a66b-2cb223c56511 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:35 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-896b6824-c7db-4423-a66b-2cb223c56511 Jul 19 17:52:35 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-cf530db9-561a-4813-b1e8-6c71daa6c5eb-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-cf530db9-561a-4813-b1e8-6c71daa6c5eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-d2a3b7ed-4612-41d0-bb1f-6d0e34635014" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:35 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.327s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-d2a3b7ed-4612-41d0-bb1f-6d0e34635014" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-cf530db9-561a-4813-b1e8-6c71daa6c5eb" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 29 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-cf530db9-561a-4813-b1e8-6c71daa6c5eb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Deleting offline snapshot cf530db9-561a-4813-b1e8-6c71daa6c5eb of volume d2a3b7ed-4612-41d0-bb1f-6d0e34635014 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] snapshot_file for this snap is: volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e639b67-fbd3-4f2b-a949-9782cea60922]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:35 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-896b6824-c7db-4423-a66b-2cb223c56511" returned: 0 in 0.373s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4132ca8-e82c-4a1c-aa6b-03c4e933bc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-896b6824-c7db-4423-a66b-2cb223c56511', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f341a34b-897c-4268-9cf6-1eea1a3c9459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:35 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Volume volume-896b6824-c7db-4423-a66b-2cb223c56511 (896b6824-c7db-4423-a66b-2cb223c56511): created successfully Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f341a34b-897c-4268-9cf6-1eea1a3c9459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Flow 'volume_create_manager' (ff78e172-397f-4aa1-afc1-26b934d5de91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:35 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c5bb44ff-9039-4470-943e-afd547d91692 tempest-ProjectReaderTests-1648104976 None] Created volume successfully. Jul 19 17:52:35 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb Jul 19 17:52:35 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:35 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb" returned: 0 in 0.462s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb5dc46-196b-4d4f-a17c-dff1b72a3144]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:35 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 Jul 19 17:52:35 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:36 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014" returned: 0 in 0.408s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:36 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb Jul 19 17:52:36 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Acquiring lock "cinder-896b6824-c7db-4423-a66b-2cb223c56511-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Lock "cinder-896b6824-c7db-4423-a66b-2cb223c56511-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Acquiring lock "cinder-quobyte-896b6824-c7db-4423-a66b-2cb223c56511" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Lock "cinder-quobyte-896b6824-c7db-4423-a66b-2cb223c56511" acquired by "delete_volume" :: waited 0.017s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:36 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[872f6c1b-4785-4035-8992-89acc824e983]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-896b6824-c7db-4423-a66b-2cb223c56511 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:36 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-896b6824-c7db-4423-a66b-2cb223c56511 Jul 19 17:52:36 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:36 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb" returned: 0 in 0.421s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:36 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb Jul 19 17:52:36 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:36 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-896b6824-c7db-4423-a66b-2cb223c56511" returned: 0 in 0.368s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-896b6824-c7db-4423-a66b-2cb223c56511 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:36 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014.cf530db9-561a-4813-b1e8-6c71daa6c5eb" returned: 0 in 0.254s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:36 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-896b6824-c7db-4423-a66b-2cb223c56511 Jul 19 17:52:36 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-cf530db9-561a-4813-b1e8-6c71daa6c5eb" released by "_delete_snapshot" :: held 1.647s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:36 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-d2a3b7ed-4612-41d0-bb1f-6d0e34635014" released by "delete_snapshot" :: held 1.674s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Created reservations ['f236ddc1-bdb6-4233-ab57-d919771e3062', '33fc2bdf-389d-48d2-8fe7-e987e0c3f62d', '6d5d6182-c4b2-4635-9fb6-76bc72765636', '12c7826e-585a-49e4-94f0-2faf1f6e020e'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:37 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Delete snapshot completed successfully. Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-0655e200-49cb-41b3-a41c-02baf7f8abd5 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-cf530db9-561a-4813-b1e8-6c71daa6c5eb-delete_snapshot" released by "delete_snapshot" :: held 1.830s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:37 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-896b6824-c7db-4423-a66b-2cb223c56511" returned: 0 in 0.249s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Lock "cinder-quobyte-896b6824-c7db-4423-a66b-2cb223c56511" released by "delete_volume" :: held 0.664s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Created reservations ['4e594531-3bd1-409e-b5dd-98c43aa1dcce', '60779025-675e-4db6-93fd-573b19d21c4d', '57f4e0f6-43b6-4d8a-9d80-b6dfacb0ec5d', '4c875626-6394-4027-9e3c-54d60266a078'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:37 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:37 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-d2a3b7ed-4612-41d0-bb1f-6d0e34635014-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-d2a3b7ed-4612-41d0-bb1f-6d0e34635014-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-d2a3b7ed-4612-41d0-bb1f-6d0e34635014" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-d2a3b7ed-4612-41d0-bb1f-6d0e34635014" acquired by "delete_volume" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:37 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.279s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:37 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Deleted volume successfully. Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[84baf12a-8969-4f42-8558-8d6cad451b53]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:37 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-aa7bae9c-3936-4e4e-9ef3-0c4d59259616 tempest-ProjectReaderTests-1648104976 None] Lock "cinder-896b6824-c7db-4423-a66b-2cb223c56511-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:37 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 Jul 19 17:52:37 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:37 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014" returned: 0 in 0.407s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:38 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014 Jul 19 17:52:38 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:38 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-d2a3b7ed-4612-41d0-bb1f-6d0e34635014" returned: 0 in 0.291s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-d2a3b7ed-4612-41d0-bb1f-6d0e34635014" released by "delete_volume" :: held 0.787s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:38 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Created reservations ['ec631c7d-f70c-44b4-a8d7-87cff980585a', '00f7f86f-edec-42ec-b77c-56a72bc4b95b', 'b185b30d-38c2-4e43-b492-1aabb03a1cbb', '5eae58e5-97a6-4d18-b9fb-b6213d4cd8d2'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:38 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:38 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:38 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:38 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.330s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:38 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:38 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Deleted volume successfully. Jul 19 17:52:38 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-4ca5501f-b5d5-49cd-99ae-1823153f9495 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-d2a3b7ed-4612-41d0-bb1f-6d0e34635014-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (9a9cc7fa-4e03-48cf-b984-889cd057daf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (371e8d5f-c7d4-4fc6-82f0-1d2406212860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (371e8d5f-c7d4-4fc6-82f0-1d2406212860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-525765150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8980c336-49a4-400f-a26d-ae4b40ee3166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:39Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8299a7e-833c-43a4-9240-4be609fbdcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8299a7e-833c-43a4-9240-4be609fbdcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eabfe8a-a33c-425e-abe6-c6953a4c2a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eabfe8a-a33c-425e-abe6-c6953a4c2a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8980c336-49a4-400f-a26d-ae4b40ee3166', 'volume_name': 'volume-8980c336-49a4-400f-a26d-ae4b40ee3166', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984b28da-352d-4dfc-8d3e-b5155014ebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984b28da-352d-4dfc-8d3e-b5155014ebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e82e4e-b4ca-4d53-93dc-4dc356d20d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:39 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Volume 8980c336-49a4-400f-a26d-ae4b40ee3166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8980c336-49a4-400f-a26d-ae4b40ee3166', 'volume_size': 1} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-525765150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8980c336-49a4-400f-a26d-ae4b40ee3166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:39Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Creating volume 8980c336-49a4-400f-a26d-ae4b40ee3166 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:39 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:39 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166 1073741824 Jul 19 17:52:39 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:39 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166 1073741824" returned: 0 in 0.522s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:39 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166 Jul 19 17:52:39 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:40 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166" returned: 0 in 0.301s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:40 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e82e4e-b4ca-4d53-93dc-4dc356d20d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8980c336-49a4-400f-a26d-ae4b40ee3166', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d82874-98ce-497b-bfd2-bf8d5ed52171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:40 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Volume volume-8980c336-49a4-400f-a26d-ae4b40ee3166 (8980c336-49a4-400f-a26d-ae4b40ee3166): created successfully Jul 19 17:52:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d82874-98ce-497b-bfd2-bf8d5ed52171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:40 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (9a9cc7fa-4e03-48cf-b984-889cd057daf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:40 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-59fb3143-1352-4535-9df9-f0d0d59a5a74 tempest-ProjectMemberTests-1812963129 None] Created volume successfully. Jul 19 17:52:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:41 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] Creating offline snapshot f090e8bc-1272-496d-a661-b2b886a8dd17 of volume 8980c336-49a4-400f-a26d-ae4b40ee3166 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:52:41 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[820c9089-ccb9-4f5d-a13b-9f911beb4c40]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:41 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166 Jul 19 17:52:41 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:41 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166" returned: 0 in 0.375s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:41 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17 1G Jul 19 17:52:41 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:52:42 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Flow 'volume_create_manager' (19b9b107-8d74-4810-8620-668fd68fa100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccdf4b70-1e24-4147-b7c7-320def9bdc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17 1G" returned: 0 in 0.554s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8980c336-49a4-400f-a26d-ae4b40ee3166 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:42 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8980c336-49a4-400f-a26d-ae4b40ee3166 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17 Jul 19 17:52:42 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccdf4b70-1e24-4147-b7c7-320def9bdc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2027672749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d29ed8-106c-4339-97c2-0b61e73cf8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69d7abb0f874d898345026a1dc638e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:42Z,use_quota=True,user_id='d33f6e047751459584d1c16a700f6388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d4c447-06b5-4579-9949-573d3077c36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d4c447-06b5-4579-9949-573d3077c36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b82b5d4-8f8f-484b-a120-c4e262739f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b82b5d4-8f8f-484b-a120-c4e262739f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0d29ed8-106c-4339-97c2-0b61e73cf8ce', 'volume_name': 'volume-c0d29ed8-106c-4339-97c2-0b61e73cf8ce', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9b425c-5077-4959-8afb-dc85e86080a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9b425c-5077-4959-8afb-dc85e86080a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a5223f-3594-4126-8c34-e4abf8c78cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:42 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Volume c0d29ed8-106c-4339-97c2-0b61e73cf8ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0d29ed8-106c-4339-97c2-0b61e73cf8ce', 'volume_size': 1} Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:42 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8980c336-49a4-400f-a26d-ae4b40ee3166 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17" returned: 0 in 0.325s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:42 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17 is being set with open permissions: ugo+rw Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:42 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17 Jul 19 17:52:42 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:42 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17" returned: 0 in 0.250s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:43 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.info Jul 19 17:52:43 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:43 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.info" returned: 0 in 0.279s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:43 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.info is being set with open permissions: ugo+rw Jul 19 17:52:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:43 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.info Jul 19 17:52:43 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:43 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.info" returned: 0 in 0.246s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.116s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.079s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2027672749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d29ed8-106c-4339-97c2-0b61e73cf8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69d7abb0f874d898345026a1dc638e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:42Z,use_quota=True,user_id='d33f6e047751459584d1c16a700f6388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Creating volume c0d29ed8-106c-4339-97c2-0b61e73cf8ce {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:43 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:43 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:43 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c0d29ed8-106c-4339-97c2-0b61e73cf8ce 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:43 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c0d29ed8-106c-4339-97c2-0b61e73cf8ce 1073741824 Jul 19 17:52:43 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:43 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-58282802-9215-455e-ada2-104cae593b85 tempest-ProjectMemberTests-1812963129 None] Create snapshot completed successfully Jul 19 17:52:44 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c0d29ed8-106c-4339-97c2-0b61e73cf8ce 1073741824" returned: 0 in 0.428s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c0d29ed8-106c-4339-97c2-0b61e73cf8ce {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:44 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c0d29ed8-106c-4339-97c2-0b61e73cf8ce Jul 19 17:52:44 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:44 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c0d29ed8-106c-4339-97c2-0b61e73cf8ce" returned: 0 in 0.252s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a5223f-3594-4126-8c34-e4abf8c78cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0d29ed8-106c-4339-97c2-0b61e73cf8ce', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263eb844-11be-452b-beac-dbb994908d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:44 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Volume volume-c0d29ed8-106c-4339-97c2-0b61e73cf8ce (c0d29ed8-106c-4339-97c2-0b61e73cf8ce): created successfully Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263eb844-11be-452b-beac-dbb994908d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Flow 'volume_create_manager' (19b9b107-8d74-4810-8620-668fd68fa100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:44 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-a46bbad0-2df9-4581-bd07-8e8b0684e927 tempest-ProjectReaderTests-786890008 None] Created volume successfully. Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-f090e8bc-1272-496d-a661-b2b886a8dd17-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-f090e8bc-1272-496d-a661-b2b886a8dd17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-8980c336-49a4-400f-a26d-ae4b40ee3166" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-8980c336-49a4-400f-a26d-ae4b40ee3166" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-f090e8bc-1272-496d-a661-b2b886a8dd17" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-f090e8bc-1272-496d-a661-b2b886a8dd17" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Deleting offline snapshot f090e8bc-1272-496d-a661-b2b886a8dd17 of volume 8980c336-49a4-400f-a26d-ae4b40ee3166 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] snapshot_file for this snap is: volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[97775e6c-8e9e-494b-bdc4-d3185c58129f]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:44 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:44 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17 Jul 19 17:52:44 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:45 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17" returned: 0 in 0.392s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:45 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8980c336-49a4-400f-a26d-ae4b40ee3166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:52:45 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcd0dee-3ee9-4e6b-8dc0-36f5375beaba]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:45 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166 Jul 19 17:52:45 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:45 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166" returned: 0 in 0.392s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:45 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17 Jul 19 17:52:45 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Acquiring lock "cinder-c0d29ed8-106c-4339-97c2-0b61e73cf8ce-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Lock "cinder-c0d29ed8-106c-4339-97c2-0b61e73cf8ce-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Acquiring lock "cinder-quobyte-c0d29ed8-106c-4339-97c2-0b61e73cf8ce" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:45 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Lock "cinder-quobyte-c0d29ed8-106c-4339-97c2-0b61e73cf8ce" acquired by "delete_volume" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:45 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a81ddb-06b2-4bf4-b83f-b6b4af9d4619]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c0d29ed8-106c-4339-97c2-0b61e73cf8ce {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:45 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17" returned: 0 in 0.406s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:45 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:45 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17 Jul 19 17:52:45 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:46 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c0d29ed8-106c-4339-97c2-0b61e73cf8ce Jul 19 17:52:46 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:46 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166.f090e8bc-1272-496d-a661-b2b886a8dd17" returned: 0 in 0.276s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-f090e8bc-1272-496d-a661-b2b886a8dd17" released by "_delete_snapshot" :: held 1.577s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-8980c336-49a4-400f-a26d-ae4b40ee3166" released by "delete_snapshot" :: held 1.598s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:46 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c0d29ed8-106c-4339-97c2-0b61e73cf8ce" returned: 0 in 0.420s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c0d29ed8-106c-4339-97c2-0b61e73cf8ce {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:46 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c0d29ed8-106c-4339-97c2-0b61e73cf8ce Jul 19 17:52:46 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Created reservations ['820bf473-2166-4e1a-bd6b-f601b9c3ceea', '8f0ce60f-7192-4675-ab96-7adb859e6d24', 'cc8a5555-8a43-442f-83ac-d6ec8613de30', 'f3c6b6f3-3b30-4ebd-ad38-deb46c34438d'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:46 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Delete snapshot completed successfully. Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5db84853-6875-4e0f-84b4-b38014057cd8 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-f090e8bc-1272-496d-a661-b2b886a8dd17-delete_snapshot" released by "delete_snapshot" :: held 1.783s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:46 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-c0d29ed8-106c-4339-97c2-0b61e73cf8ce" returned: 0 in 0.264s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Lock "cinder-quobyte-c0d29ed8-106c-4339-97c2-0b61e73cf8ce" released by "delete_volume" :: held 0.727s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Created reservations ['b3af4f21-fd8c-4de7-a57e-7c89ed549e6d', '8d935ecb-9315-4214-970c-9465d398220e', 'bc634001-921a-42ee-b16a-b54352ad807c', '7efa0f92-8412-4c8a-8555-7e49a51f8633'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:46 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:46 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-8980c336-49a4-400f-a26d-ae4b40ee3166-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-8980c336-49a4-400f-a26d-ae4b40ee3166-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-8980c336-49a4-400f-a26d-ae4b40ee3166" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:46 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-8980c336-49a4-400f-a26d-ae4b40ee3166" acquired by "delete_volume" :: waited 0.029s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:46 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.332s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:47 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Deleted volume successfully. Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfd9821-1676-458a-b1a0-73fc08cbf08f]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-71b92b44-3249-4358-b26c-c5f2d710042a tempest-ProjectReaderTests-786890008 None] Lock "cinder-c0d29ed8-106c-4339-97c2-0b61e73cf8ce-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:47 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166 Jul 19 17:52:47 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:47 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166" returned: 0 in 0.423s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:47 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166 Jul 19 17:52:47 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Flow 'volume_create_manager' (f068c44a-d879-4c30-8ccc-a48176eb2512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dcbe101-f644-425c-99d0-3c4ee9b600e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dcbe101-f644-425c-99d0-3c4ee9b600e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-806150498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d6d818-5119-4b19-ba3a-29a28cbfa244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69d7abb0f874d898345026a1dc638e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:48Z,use_quota=True,user_id='d33f6e047751459584d1c16a700f6388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903f0f82-f1d1-4eaa-94c9-62eb6c33c3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903f0f82-f1d1-4eaa-94c9-62eb6c33c3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6405fbdd-1834-4eb8-a792-4ba1e1a67583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6405fbdd-1834-4eb8-a792-4ba1e1a67583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d6d818-5119-4b19-ba3a-29a28cbfa244', 'volume_name': 'volume-e1d6d818-5119-4b19-ba3a-29a28cbfa244', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b388df6-e220-4b4f-ace4-ec2561f69165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b388df6-e220-4b4f-ace4-ec2561f69165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15486fd1-ed15-4e07-8262-d7770cad0faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:47 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Volume e1d6d818-5119-4b19-ba3a-29a28cbfa244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d6d818-5119-4b19-ba3a-29a28cbfa244', 'volume_size': 1} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-806150498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d6d818-5119-4b19-ba3a-29a28cbfa244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69d7abb0f874d898345026a1dc638e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:48Z,use_quota=True,user_id='d33f6e047751459584d1c16a700f6388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Creating volume e1d6d818-5119-4b19-ba3a-29a28cbfa244 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:47 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e1d6d818-5119-4b19-ba3a-29a28cbfa244 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:47 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:47 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e1d6d818-5119-4b19-ba3a-29a28cbfa244 1073741824 Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-8980c336-49a4-400f-a26d-ae4b40ee3166" returned: 0 in 0.270s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:47 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-8980c336-49a4-400f-a26d-ae4b40ee3166" released by "delete_volume" :: held 0.793s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Created reservations ['847efefe-01f4-48cf-83c9-949c770eae82', 'b253cc8b-f8b3-486c-8098-5570a38919b9', '86d816c7-26f3-4a2f-9625-629e171e445f', '6790912a-0e69-474c-9e48-04212d32f162'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:47 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:47 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:47 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:48 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:48 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e1d6d818-5119-4b19-ba3a-29a28cbfa244 1073741824" returned: 0 in 0.544s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.365s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:48 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Deleted volume successfully. Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-c63434c3-b944-4d71-be5a-2375ca731b92 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-8980c336-49a4-400f-a26d-ae4b40ee3166-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e1d6d818-5119-4b19-ba3a-29a28cbfa244 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:48 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e1d6d818-5119-4b19-ba3a-29a28cbfa244 Jul 19 17:52:48 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (0378907a-b2e0-498d-b54a-ca463b815db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ced7453-79a8-4d44-9c75-7f30636f003d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ced7453-79a8-4d44-9c75-7f30636f003d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095595905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0070c9ee-744b-4044-80b2-39a1baa7e6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:49Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:48 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b92493f-c8b4-4f83-9cc2-94167937915a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b92493f-c8b4-4f83-9cc2-94167937915a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5778e9-f807-4cdc-8cd4-d2892581ed0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5778e9-f807-4cdc-8cd4-d2892581ed0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0070c9ee-744b-4044-80b2-39a1baa7e6f3', 'volume_name': 'volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85e308c-851f-49e4-bb49-fcb6df06a110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85e308c-851f-49e4-bb49-fcb6df06a110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e88ce64-397c-453f-aae1-a34573f1bacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:48 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Volume 0070c9ee-744b-4044-80b2-39a1baa7e6f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3', 'volume_size': 1} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e1d6d818-5119-4b19-ba3a-29a28cbfa244" returned: 0 in 0.339s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095595905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0070c9ee-744b-4044-80b2-39a1baa7e6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:49Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Creating volume 0070c9ee-744b-4044-80b2-39a1baa7e6f3 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:48 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15486fd1-ed15-4e07-8262-d7770cad0faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d6d818-5119-4b19-ba3a-29a28cbfa244', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:48 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 1073741824 Jul 19 17:52:48 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c2ae0c-d943-4d3c-9f4b-d884cf61c84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:48 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Volume volume-e1d6d818-5119-4b19-ba3a-29a28cbfa244 (e1d6d818-5119-4b19-ba3a-29a28cbfa244): created successfully Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c2ae0c-d943-4d3c-9f4b-d884cf61c84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:48 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Flow 'volume_create_manager' (f068c44a-d879-4c30-8ccc-a48176eb2512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:48 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-6cc178f0-ae6f-42f9-9203-cfcdc54dd695 tempest-ProjectReaderTests-786890008 None] Created volume successfully. Jul 19 17:52:49 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 1073741824" returned: 0 in 0.449s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:49 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 Jul 19 17:52:49 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:49 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3" returned: 0 in 0.289s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:49 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e88ce64-397c-453f-aae1-a34573f1bacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8a9fd4-20d7-4ac4-bf57-c73dc4ffdcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:49 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Volume volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 (0070c9ee-744b-4044-80b2-39a1baa7e6f3): created successfully Jul 19 17:52:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8a9fd4-20d7-4ac4-bf57-c73dc4ffdcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:49 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (0378907a-b2e0-498d-b54a-ca463b815db2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:49 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-c4f40e84-59ae-47ce-b73a-e29c7bd623cf tempest-ProjectMemberTests-1812963129 None] Created volume successfully. Jul 19 17:52:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Acquiring lock "cinder-e1d6d818-5119-4b19-ba3a-29a28cbfa244-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Lock "cinder-e1d6d818-5119-4b19-ba3a-29a28cbfa244-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Acquiring lock "cinder-quobyte-e1d6d818-5119-4b19-ba3a-29a28cbfa244" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:49 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Lock "cinder-quobyte-e1d6d818-5119-4b19-ba3a-29a28cbfa244" acquired by "delete_volume" :: waited 0.015s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:49 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c934eb86-6064-4dce-8d01-6c21822f5daf]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:49 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e1d6d818-5119-4b19-ba3a-29a28cbfa244 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:49 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e1d6d818-5119-4b19-ba3a-29a28cbfa244 Jul 19 17:52:49 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:50 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e1d6d818-5119-4b19-ba3a-29a28cbfa244" returned: 0 in 0.381s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e1d6d818-5119-4b19-ba3a-29a28cbfa244 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:50 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e1d6d818-5119-4b19-ba3a-29a28cbfa244 Jul 19 17:52:50 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:50 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-e1d6d818-5119-4b19-ba3a-29a28cbfa244" returned: 0 in 0.241s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:50 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Lock "cinder-quobyte-e1d6d818-5119-4b19-ba3a-29a28cbfa244" released by "delete_volume" :: held 0.679s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:50 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Created reservations ['a874ee7a-1458-4e0b-a038-7d1b6df169b2', 'd4f7268e-c18d-494c-abc1-cfb5097475ac', '1bf84f7b-d723-4689-8988-31eaeff5f7f6', '6f48e7ab-6b38-4330-8e77-78ead765de27'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:50 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:50 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:50 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] Creating offline snapshot 7570c860-8b61-4d23-be90-363cce88b5cd of volume 0070c9ee-744b-4044-80b2-39a1baa7e6f3 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:52:50 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c444bab0-d3eb-414a-a222-96dd28ee1092]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:50 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:51 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 Jul 19 17:52:51 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:51 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.584s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:51 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Deleted volume successfully. Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ba839dc-202b-408b-b08d-ba5e359100ff tempest-ProjectReaderTests-786890008 None] Lock "cinder-e1d6d818-5119-4b19-ba3a-29a28cbfa244-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:52:51 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Flow 'volume_create_manager' (c15c28e1-fb6a-4cd8-aded-51efb78041be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a478057-7e14-4f74-a496-dc8d284f3e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3" returned: 0 in 0.649s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:51 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd 1G Jul 19 17:52:51 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a478057-7e14-4f74-a496-dc8d284f3e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1200264738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3966c0e4-d863-49cb-b22e-50176e3883c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69d7abb0f874d898345026a1dc638e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:52Z,use_quota=True,user_id='d33f6e047751459584d1c16a700f6388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14babae1-4869-4c92-8593-3c669fea791a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14babae1-4869-4c92-8593-3c669fea791a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f618fe28-6956-40f0-96d1-85c3ae8f6b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f618fe28-6956-40f0-96d1-85c3ae8f6b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3966c0e4-d863-49cb-b22e-50176e3883c2', 'volume_name': 'volume-3966c0e4-d863-49cb-b22e-50176e3883c2', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade5fe57-f232-4b7f-bcba-2cb6a2e37d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade5fe57-f232-4b7f-bcba-2cb6a2e37d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbffabf6-30bc-4187-a6d5-a56dc46ade39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:51 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Volume 3966c0e4-d863-49cb-b22e-50176e3883c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3966c0e4-d863-49cb-b22e-50176e3883c2', 'volume_size': 1} Jul 19 17:52:51 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:52 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd 1G" returned: 0 in 0.446s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:52 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd Jul 19 17:52:52 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:52 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd" returned: 0 in 0.328s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:52 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd is being set with open permissions: ugo+rw Jul 19 17:52:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:52 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd Jul 19 17:52:52 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:52 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd" returned: 0 in 0.272s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:52 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.info Jul 19 17:52:52 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:52 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.info" returned: 0 in 0.270s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:52 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.info is being set with open permissions: ugo+rw Jul 19 17:52:52 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:53 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.info Jul 19 17:52:53 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:53 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.info" returned: 0 in 0.310s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.395s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.622s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1200264738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3966c0e4-d863-49cb-b22e-50176e3883c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69d7abb0f874d898345026a1dc638e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:52Z,use_quota=True,user_id='d33f6e047751459584d1c16a700f6388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Creating volume 3966c0e4-d863-49cb-b22e-50176e3883c2 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:53 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:53 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3966c0e4-d863-49cb-b22e-50176e3883c2 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:53 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8a987e70-2335-47b1-a396-edb2510fd046 tempest-ProjectMemberTests-1812963129 None] Create snapshot completed successfully Jul 19 17:52:53 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3966c0e4-d863-49cb-b22e-50176e3883c2 1073741824 Jul 19 17:52:53 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:53 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3966c0e4-d863-49cb-b22e-50176e3883c2 1073741824" returned: 0 in 0.484s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:53 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3966c0e4-d863-49cb-b22e-50176e3883c2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:53 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3966c0e4-d863-49cb-b22e-50176e3883c2 Jul 19 17:52:53 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-7570c860-8b61-4d23-be90-363cce88b5cd-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Lock "cinder-7570c860-8b61-4d23-be90-363cce88b5cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-0070c9ee-744b-4044-80b2-39a1baa7e6f3" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-0070c9ee-744b-4044-80b2-39a1baa7e6f3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-7570c860-8b61-4d23-be90-363cce88b5cd" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:54 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3966c0e4-d863-49cb-b22e-50176e3883c2" returned: 0 in 0.322s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-7570c860-8b61-4d23-be90-363cce88b5cd" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Deleting offline snapshot 7570c860-8b61-4d23-be90-363cce88b5cd of volume 0070c9ee-744b-4044-80b2-39a1baa7e6f3 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] snapshot_file for this snap is: volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbffabf6-30bc-4187-a6d5-a56dc46ade39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3966c0e4-d863-49cb-b22e-50176e3883c2', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f02037-1dfe-421d-92ac-af835dd64e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5ffbb9-e7ef-4b30-a753-c48fe36af3a3]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:54 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Volume volume-3966c0e4-d863-49cb-b22e-50176e3883c2 (3966c0e4-d863-49cb-b22e-50176e3883c2): created successfully Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f02037-1dfe-421d-92ac-af835dd64e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Flow 'volume_create_manager' (c15c28e1-fb6a-4cd8-aded-51efb78041be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:54 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-cdf00893-6722-4f97-8ea7-9de14fcc7fbe tempest-ProjectReaderTests-786890008 None] Created volume successfully. Jul 19 17:52:54 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd Jul 19 17:52:54 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:54 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd" returned: 0 in 0.424s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[776bb4c8-278f-4f50-90f6-600d764679c3]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Acquiring lock "cinder-3966c0e4-d863-49cb-b22e-50176e3883c2-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Lock "cinder-3966c0e4-d863-49cb-b22e-50176e3883c2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:54 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 Jul 19 17:52:54 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Acquiring lock "cinder-quobyte-3966c0e4-d863-49cb-b22e-50176e3883c2" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Lock "cinder-quobyte-3966c0e4-d863-49cb-b22e-50176e3883c2" acquired by "delete_volume" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d927f5f-219d-48b0-bc23-df0a30eadf6f]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:54 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3966c0e4-d863-49cb-b22e-50176e3883c2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:55 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3966c0e4-d863-49cb-b22e-50176e3883c2 Jul 19 17:52:55 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:55 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3" returned: 0 in 0.493s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:55 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd Jul 19 17:52:55 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:55 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3966c0e4-d863-49cb-b22e-50176e3883c2" returned: 0 in 0.480s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3966c0e4-d863-49cb-b22e-50176e3883c2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:55 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3966c0e4-d863-49cb-b22e-50176e3883c2 Jul 19 17:52:55 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:55 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd" returned: 0 in 0.431s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:55 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd Jul 19 17:52:55 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:55 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3966c0e4-d863-49cb-b22e-50176e3883c2" returned: 0 in 0.341s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:55 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Lock "cinder-quobyte-3966c0e4-d863-49cb-b22e-50176e3883c2" released by "delete_volume" :: held 0.912s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:55 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Created reservations ['31f21880-93b7-48a0-8263-95e16ba010a0', 'ed21b074-cb4b-44a6-b119-9622fa256f58', '8af4acea-3fda-432d-89c7-bd421a881294', 'e89ae1b6-bd2e-4660-9353-125b61245a49'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:55 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:55 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3.7570c860-8b61-4d23-be90-363cce88b5cd" returned: 0 in 0.357s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-7570c860-8b61-4d23-be90-363cce88b5cd" released by "_delete_snapshot" :: held 1.859s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-0070c9ee-744b-4044-80b2-39a1baa7e6f3" released by "delete_snapshot" :: held 1.907s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:56 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:56 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:56 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:56 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Created reservations ['b8c06007-0503-45f0-94ae-cbddb83080c3', '72caa8ca-098d-4d3d-94ee-7b8f346f9c78', 'c139dc50-2e75-4800-9b60-596a1303381c', '47feb793-3862-48f0-9341-7a3afda6a7a1'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:56 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Delete snapshot completed successfully. Jul 19 17:52:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-bc878f2d-d673-4383-9158-07ce878af3df tempest-ProjectMemberTests-1812963129 None] Lock "cinder-7570c860-8b61-4d23-be90-363cce88b5cd-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:56 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:56 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.315s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:56 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:56 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Deleted volume successfully. Jul 19 17:52:56 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-1bd9b374-d638-482a-a4ae-dabe652ecb49 tempest-ProjectReaderTests-786890008 None] Lock "cinder-3966c0e4-d863-49cb-b22e-50176e3883c2-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-0070c9ee-744b-4044-80b2-39a1baa7e6f3-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-0070c9ee-744b-4044-80b2-39a1baa7e6f3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-0070c9ee-744b-4044-80b2-39a1baa7e6f3" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-0070c9ee-744b-4044-80b2-39a1baa7e6f3" acquired by "delete_volume" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2ff077-2a28-4aca-8f57-8834ff04a9f7]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:52:57 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Flow 'volume_create_manager' (4147132c-c617-45ce-b19d-906a16d66981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:57 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a93644-f8dc-4351-bae0-1da642bf8750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a93644-f8dc-4351-bae0-1da642bf8750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1775076048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4a880e-28ad-4adf-a9fa-a0609deb3a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69d7abb0f874d898345026a1dc638e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:58Z,use_quota=True,user_id='d33f6e047751459584d1c16a700f6388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeedb677-17e5-40ee-8801-7dbd73e2f99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeedb677-17e5-40ee-8801-7dbd73e2f99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2736f3f-8839-4626-8ac3-134529182776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2736f3f-8839-4626-8ac3-134529182776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a4a880e-28ad-4adf-a9fa-a0609deb3a69', 'volume_name': 'volume-2a4a880e-28ad-4adf-a9fa-a0609deb3a69', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e6d8bd-5d0e-4cab-9a75-bcee65bc5e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e6d8bd-5d0e-4cab-9a75-bcee65bc5e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2541be5c-d43f-4147-9a27-ece127a763a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:57 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Volume 2a4a880e-28ad-4adf-a9fa-a0609deb3a69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a4a880e-28ad-4adf-a9fa-a0609deb3a69', 'volume_size': 1} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1775076048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4a880e-28ad-4adf-a9fa-a0609deb3a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69d7abb0f874d898345026a1dc638e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:58Z,use_quota=True,user_id='d33f6e047751459584d1c16a700f6388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Creating volume 2a4a880e-28ad-4adf-a9fa-a0609deb3a69 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:57 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2a4a880e-28ad-4adf-a9fa-a0609deb3a69 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:57 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2a4a880e-28ad-4adf-a9fa-a0609deb3a69 1073741824 Jul 19 17:52:57 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:57 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3" returned: 0 in 0.426s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:57 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:57 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3 Jul 19 17:52:57 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:58 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:58 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2a4a880e-28ad-4adf-a9fa-a0609deb3a69 1073741824" returned: 0 in 0.550s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0070c9ee-744b-4044-80b2-39a1baa7e6f3" returned: 0 in 0.344s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-0070c9ee-744b-4044-80b2-39a1baa7e6f3" released by "delete_volume" :: held 0.864s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2a4a880e-28ad-4adf-a9fa-a0609deb3a69 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:58 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2a4a880e-28ad-4adf-a9fa-a0609deb3a69 Jul 19 17:52:58 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Created reservations ['5031d6c6-7a7b-4e73-803e-0f188f1ebc7c', 'ce659b02-bcab-4873-b1e8-cf2850c0d041', '8d86cd08-52ef-48f2-bdf8-4dae3b032af8', 'd09e2387-ed29-4e57-9ed2-311caa60d0c0'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:58 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:52:58 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:58 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2a4a880e-28ad-4adf-a9fa-a0609deb3a69" returned: 0 in 0.276s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2541be5c-d43f-4147-9a27-ece127a763a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a4a880e-28ad-4adf-a9fa-a0609deb3a69', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85579edc-604d-4745-8b1c-b71c215fcbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:58 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Volume volume-2a4a880e-28ad-4adf-a9fa-a0609deb3a69 (2a4a880e-28ad-4adf-a9fa-a0609deb3a69): created successfully Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85579edc-604d-4745-8b1c-b71c215fcbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Flow 'volume_create_manager' (4147132c-c617-45ce-b19d-906a16d66981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:58 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-0a9c0ce4-3854-49e3-b5fb-853a413608c4 tempest-ProjectReaderTests-786890008 None] Created volume successfully. Jul 19 17:52:58 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.307s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:52:58 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Deleted volume successfully. Jul 19 17:52:58 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-9a616aad-b2ee-469b-a410-c662497947f6 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-0070c9ee-744b-4044-80b2-39a1baa7e6f3-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (d31b8375-1e63-4793-9710-cfcf84f6dda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ac70a4-ea87-4924-9f57-57024b648948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ac70a4-ea87-4924-9f57-57024b648948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-843473572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470cc779-c215-46f3-acee-1e8766d4e0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:59Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e866a92c-97cd-467c-9c74-9e4a95145f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e866a92c-97cd-467c-9c74-9e4a95145f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9c92a4-342d-443d-935a-489ec392ca82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9c92a4-342d-443d-935a-489ec392ca82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '470cc779-c215-46f3-acee-1e8766d4e0ed', 'volume_name': 'volume-470cc779-c215-46f3-acee-1e8766d4e0ed', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ed5d9b-51ee-4bab-b3e4-1cb75d244523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ed5d9b-51ee-4bab-b3e4-1cb75d244523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d00510e4-5934-4f6c-b242-f09420777fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:59 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Volume 470cc779-c215-46f3-acee-1e8766d4e0ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-470cc779-c215-46f3-acee-1e8766d4e0ed', 'volume_size': 1} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-843473572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470cc779-c215-46f3-acee-1e8766d4e0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:52:59Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Creating volume 470cc779-c215-46f3-acee-1e8766d4e0ed {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:52:59 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:59 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed 1073741824 Jul 19 17:52:59 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:59 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed 1073741824" returned: 0 in 0.439s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:59 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed Jul 19 17:52:59 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Acquiring lock "cinder-2a4a880e-28ad-4adf-a9fa-a0609deb3a69-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Lock "cinder-2a4a880e-28ad-4adf-a9fa-a0609deb3a69-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Acquiring lock "cinder-quobyte-2a4a880e-28ad-4adf-a9fa-a0609deb3a69" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Lock "cinder-quobyte-2a4a880e-28ad-4adf-a9fa-a0609deb3a69" acquired by "delete_volume" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[91799099-5e0a-4f76-af4f-49733b6c88c0]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2a4a880e-28ad-4adf-a9fa-a0609deb3a69 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:52:59 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed" returned: 0 in 0.296s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d00510e4-5934-4f6c-b242-f09420777fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-470cc779-c215-46f3-acee-1e8766d4e0ed', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:52:59 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b02e4d7-a9c5-469e-8793-9e3acdc654ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:52:59 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Volume volume-470cc779-c215-46f3-acee-1e8766d4e0ed (470cc779-c215-46f3-acee-1e8766d4e0ed): created successfully Jul 19 17:53:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b02e4d7-a9c5-469e-8793-9e3acdc654ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:00 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2a4a880e-28ad-4adf-a9fa-a0609deb3a69 Jul 19 17:53:00 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:00 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (d31b8375-1e63-4793-9710-cfcf84f6dda2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:53:00 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b58acff9-c5cb-4a28-9e99-8b8410150df8 tempest-ProjectMemberTests-1812963129 None] Created volume successfully. Jul 19 17:53:00 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2a4a880e-28ad-4adf-a9fa-a0609deb3a69" returned: 0 in 0.399s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2a4a880e-28ad-4adf-a9fa-a0609deb3a69 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:00 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2a4a880e-28ad-4adf-a9fa-a0609deb3a69 Jul 19 17:53:00 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:00 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-2a4a880e-28ad-4adf-a9fa-a0609deb3a69" returned: 0 in 0.278s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:00 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Lock "cinder-quobyte-2a4a880e-28ad-4adf-a9fa-a0609deb3a69" released by "delete_volume" :: held 0.725s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:00 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Created reservations ['963b376f-9213-4b80-8a84-f04b792e34d0', '0cd23df5-c4f9-43da-9b84-ede81c936f48', 'd13fcd78-b715-461e-a0c1-b5e9f0faa8b1', '679dbff5-f256-42f1-aa11-54bacc4d6dff'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:53:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:53:00 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:53:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:00 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:53:00 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:00 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:00 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.261s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:00 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:53:00 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Deleted volume successfully. Jul 19 17:53:01 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-8cd8207b-23fb-44a3-888c-0bfd69cb81d8 tempest-ProjectReaderTests-786890008 None] Lock "cinder-2a4a880e-28ad-4adf-a9fa-a0609deb3a69-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:01 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] Creating offline snapshot 8a520249-d776-4bb0-9e0f-e9236f06a050 of volume 470cc779-c215-46f3-acee-1e8766d4e0ed {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:53:01 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddc700c-11e3-49ee-8b1f-77640ca4c230]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:01 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed Jul 19 17:53:01 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:01 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed" returned: 0 in 0.424s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:01 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:01 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050 1G Jul 19 17:53:01 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:02 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050 1G" returned: 0 in 0.513s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-470cc779-c215-46f3-acee-1e8766d4e0ed -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:02 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-470cc779-c215-46f3-acee-1e8766d4e0ed -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050 Jul 19 17:53:02 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:02 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-470cc779-c215-46f3-acee-1e8766d4e0ed -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050" returned: 0 in 0.369s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:02 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050 is being set with open permissions: ugo+rw Jul 19 17:53:02 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:02 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050 Jul 19 17:53:02 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:03 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050" returned: 0 in 0.296s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:03 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.info Jul 19 17:53:03 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:03 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.info" returned: 0 in 0.279s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:03 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.info is being set with open permissions: ugo+rw Jul 19 17:53:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:03 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.info Jul 19 17:53:03 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:03 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.info" returned: 0 in 0.245s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:03 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:03 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-fce801bd-9784-4aab-9467-ce494e5a4233 tempest-ProjectMemberTests-1812963129 None] Create snapshot completed successfully Jul 19 17:53:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-8a520249-d776-4bb0-9e0f-e9236f06a050-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Lock "cinder-8a520249-d776-4bb0-9e0f-e9236f06a050-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-470cc779-c215-46f3-acee-1e8766d4e0ed" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-470cc779-c215-46f3-acee-1e8766d4e0ed" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-8a520249-d776-4bb0-9e0f-e9236f06a050" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:04 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-8a520249-d776-4bb0-9e0f-e9236f06a050" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Deleting offline snapshot 8a520249-d776-4bb0-9e0f-e9236f06a050 of volume 470cc779-c215-46f3-acee-1e8766d4e0ed {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:53:04 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] snapshot_file for this snap is: volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:53:04 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e488874-7ac8-49b8-bdb3-643d904391bc]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:04 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:04 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050 Jul 19 17:53:04 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:05 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050" returned: 0 in 0.389s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:05 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-470cc779-c215-46f3-acee-1e8766d4e0ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:53:05 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cff1be-21c3-490e-b228-bf7bed39533a]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:05 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed Jul 19 17:53:05 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:05 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed" returned: 0 in 0.363s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:05 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050 Jul 19 17:53:05 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:05 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050" returned: 0 in 0.406s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:05 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:05 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050 Jul 19 17:53:05 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:06 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed.8a520249-d776-4bb0-9e0f-e9236f06a050" returned: 0 in 0.258s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-8a520249-d776-4bb0-9e0f-e9236f06a050" released by "_delete_snapshot" :: held 1.536s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-470cc779-c215-46f3-acee-1e8766d4e0ed" released by "delete_snapshot" :: held 1.564s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:06 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Created reservations ['25de8f66-c064-4ca1-9669-f46ac4df1cdb', 'eee934d2-af95-4301-b313-5e76ad2656c9', '1ab42b0b-8419-45eb-b1a3-7b3cfe97cbb1', '8526eaa6-9307-4490-9b75-e49143a2b302'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:53:06 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Delete snapshot completed successfully. Jul 19 17:53:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-3ffa1b15-839f-466a-abeb-8d4d528aaecd tempest-ProjectMemberTests-1812963129 None] Lock "cinder-8a520249-d776-4bb0-9e0f-e9236f06a050-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-470cc779-c215-46f3-acee-1e8766d4e0ed-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Lock "cinder-470cc779-c215-46f3-acee-1e8766d4e0ed-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-470cc779-c215-46f3-acee-1e8766d4e0ed" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:06 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-470cc779-c215-46f3-acee-1e8766d4e0ed" acquired by "delete_volume" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:06 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed02e678-aa61-4f32-a072-21a2eb746367]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:06 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:07 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed Jul 19 17:53:07 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:07 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed" returned: 0 in 0.389s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:07 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed Jul 19 17:53:07 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:07 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-470cc779-c215-46f3-acee-1e8766d4e0ed" returned: 0 in 0.292s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:07 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-470cc779-c215-46f3-acee-1e8766d4e0ed" released by "delete_volume" :: held 0.772s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:07 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Created reservations ['5f8c94af-02c4-4791-ae3b-3df174140e3e', '00d1e906-d0fa-4bfa-9952-505988ede097', '7fd9054a-dd8f-4a43-a585-777b11aeb3f3', 'd3491b9f-ffaf-4d65-8e2b-85850adec4a6'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:53:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:53:07 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:53:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:07 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:07 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:53:07 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:08 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.283s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:53:08 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Deleted volume successfully. Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-456925cd-99d1-4d41-bdf5-cf82c9964edb tempest-ProjectMemberTests-1812963129 None] Lock "cinder-470cc779-c215-46f3-acee-1e8766d4e0ed-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (14c127c8-a5a8-4638-9717-982ece7e1aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb62653e-ec4c-42e5-a1f3-2726209f6f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb62653e-ec4c-42e5-a1f3-2726209f6f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-627238011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce33d12-7ee3-40e0-9813-f0cd9a253b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:53:09Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6040ca-daff-4fcb-a093-2ef46426d79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6040ca-daff-4fcb-a093-2ef46426d79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f53ac14-57de-4dae-8bdc-763899531ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f53ac14-57de-4dae-8bdc-763899531ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce33d12-7ee3-40e0-9813-f0cd9a253b4c', 'volume_name': 'volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b6c2ec-d5dc-4bb1-9862-da35ef793e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b6c2ec-d5dc-4bb1-9862-da35ef793e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca78877f-378c-47a2-87ed-84ebd4c808e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:08 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Volume 0ce33d12-7ee3-40e0-9813-f0cd9a253b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c', 'volume_size': 1} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-627238011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce33d12-7ee3-40e0-9813-f0cd9a253b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:53:09Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Creating volume 0ce33d12-7ee3-40e0-9813-f0cd9a253b4c {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:53:08 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:08 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c 1073741824 Jul 19 17:53:08 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Flow 'volume_create_manager' (bd99a86b-7b1b-4c9a-b53b-671de0814ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b74f995-4dff-4b3c-b47b-c825a5d023cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b74f995-4dff-4b3c-b47b-c825a5d023cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1951384717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3254711f-c007-44dc-8000-3182cdcba4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a129ce71be3c4c5d955fb723947f6900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:53:09Z,use_quota=True,user_id='c1810ed050c048039e1d924ec39adca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9c9bef-0193-4ecb-972b-bbce1dbfd0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9c9bef-0193-4ecb-972b-bbce1dbfd0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e03c8d0-4489-4e8e-995a-0135ed140554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e03c8d0-4489-4e8e-995a-0135ed140554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3254711f-c007-44dc-8000-3182cdcba4c1', 'volume_name': 'volume-3254711f-c007-44dc-8000-3182cdcba4c1', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fab82f-241d-4a44-9975-aa9b9c78eee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fab82f-241d-4a44-9975-aa9b9c78eee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f8926c-509c-4293-9313-804e002d2b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:08 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Volume 3254711f-c007-44dc-8000-3182cdcba4c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3254711f-c007-44dc-8000-3182cdcba4c1', 'volume_size': 1} Jul 19 17:53:08 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:09 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c 1073741824" returned: 0 in 0.444s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:09 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c Jul 19 17:53:09 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:09 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c" returned: 0 in 0.245s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.549s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1951384717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3254711f-c007-44dc-8000-3182cdcba4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a129ce71be3c4c5d955fb723947f6900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:53:09Z,use_quota=True,user_id='c1810ed050c048039e1d924ec39adca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Creating volume 3254711f-c007-44dc-8000-3182cdcba4c1 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:53:09 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca78877f-378c-47a2-87ed-84ebd4c808e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:09 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 1073741824 Jul 19 17:53:09 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e06601-605f-4633-a2c7-2ccddff5114b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:09 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Volume volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c (0ce33d12-7ee3-40e0-9813-f0cd9a253b4c): created successfully Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e06601-605f-4633-a2c7-2ccddff5114b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (14c127c8-a5a8-4638-9717-982ece7e1aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:53:09 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-6ccec43e-ab90-4eed-9406-e40b496905ee tempest-ProjectMemberTests-1812963129 None] Created volume successfully. Jul 19 17:53:09 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 1073741824" returned: 0 in 0.423s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:09 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:09 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 Jul 19 17:53:09 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:10 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1" returned: 0 in 0.240s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:53:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f8926c-509c-4293-9313-804e002d2b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3254711f-c007-44dc-8000-3182cdcba4c1', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b4da1f-655b-4829-972e-849171ba69ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:10 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Volume volume-3254711f-c007-44dc-8000-3182cdcba4c1 (3254711f-c007-44dc-8000-3182cdcba4c1): created successfully Jul 19 17:53:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b4da1f-655b-4829-972e-849171ba69ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:10 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Flow 'volume_create_manager' (bd99a86b-7b1b-4c9a-b53b-671de0814ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:53:10 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-e5b234cf-43bd-417a-88f4-892cd89d8b3f tempest-SnapshotDependencyTests-251648163 None] Created volume successfully. Jul 19 17:53:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:10 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] Creating offline snapshot e446ee95-be03-4f6e-8b66-339e74066e80 of volume 0ce33d12-7ee3-40e0-9813-f0cd9a253b4c {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:53:10 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[44104e58-0f1e-4cc7-a8c7-791de60ee14f]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:10 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:10 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c Jul 19 17:53:10 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:11 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c" returned: 0 in 0.402s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:11 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80 1G Jul 19 17:53:11 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:11 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80 1G" returned: 0 in 0.370s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:11 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80 Jul 19 17:53:11 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:11 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80" returned: 0 in 0.270s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:11 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80 is being set with open permissions: ugo+rw Jul 19 17:53:11 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:11 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80 Jul 19 17:53:11 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:12 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80" returned: 0 in 0.240s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:12 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.info Jul 19 17:53:12 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:12 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.info" returned: 0 in 0.236s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:12 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.info is being set with open permissions: ugo+rw Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:12 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.info Jul 19 17:53:12 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:12 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.info" returned: 0 in 0.232s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.485s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:DELETE=21,cinder:UPDATE=228,cinder:SELECT=174,cinder:INSERT=63 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] Creating offline snapshot b5e3a860-b613-434b-a52a-6efee02d77c4 of volume 3254711f-c007-44dc-8000-3182cdcba4c1 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:53:12 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b6daddd5-8176-4536-9ca2-451c0404d473 tempest-ProjectMemberTests-1812963129 None] Create snapshot completed successfully Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0049e27d-9ed2-47bb-95bb-169f482428d7]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:12 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 Jul 19 17:53:12 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-e446ee95-be03-4f6e-8b66-339e74066e80-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-e446ee95-be03-4f6e-8b66-339e74066e80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-e446ee95-be03-4f6e-8b66-339e74066e80" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-e446ee95-be03-4f6e-8b66-339e74066e80" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Deleting offline snapshot e446ee95-be03-4f6e-8b66-339e74066e80 of volume 0ce33d12-7ee3-40e0-9813-f0cd9a253b4c {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] snapshot_file for this snap is: volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[488f162c-2437-4f0b-bcc7-3aefff65f09f]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:12 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:13 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1" returned: 0 in 0.374s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:13 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80 Jul 19 17:53:13 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:13 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 1G Jul 19 17:53:13 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:13 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80" returned: 0 in 0.368s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:13 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:53:13 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bc4485-a627-4630-bf1e-f25cba0ea2e5]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:13 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c Jul 19 17:53:13 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:13 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 1G" returned: 0 in 0.414s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3254711f-c007-44dc-8000-3182cdcba4c1 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:13 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3254711f-c007-44dc-8000-3182cdcba4c1 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 Jul 19 17:53:13 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:13 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c" returned: 0 in 0.353s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:13 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80 Jul 19 17:53:13 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:13 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3254711f-c007-44dc-8000-3182cdcba4c1 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4" returned: 0 in 0.284s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:13 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 is being set with open permissions: ugo+rw Jul 19 17:53:13 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:13 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 Jul 19 17:53:13 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:14 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4" returned: 0 in 0.261s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:14 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=164,cinder:INSERT=61,cinder:UPDATE=221,cinder:DELETE=19 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:53:14 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80" returned: 0 in 0.340s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:14 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80 Jul 19 17:53:14 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:14 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.info Jul 19 17:53:14 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:14 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c.e446ee95-be03-4f6e-8b66-339e74066e80" returned: 0 in 0.248s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:14 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.info" returned: 0 in 0.251s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:14 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.info is being set with open permissions: ugo+rw Jul 19 17:53:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-e446ee95-be03-4f6e-8b66-339e74066e80" released by "_delete_snapshot" :: held 1.407s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c" released by "delete_snapshot" :: held 1.431s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:14 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.info Jul 19 17:53:14 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:14 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Created reservations ['fdf4cf0b-f04b-41ab-95f3-6ba021f71944', '11ac0959-b305-4929-89a6-332121335169', 'f98adb19-b9ba-402a-b705-a850d5489e78', 'fb0ac704-65e6-4179-8dd3-028300b0de49'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:53:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Delete snapshot completed successfully. Jul 19 17:53:14 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f39deb78-e843-48d8-999d-f59b2458d983 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-e446ee95-be03-4f6e-8b66-339e74066e80-delete_snapshot" released by "delete_snapshot" :: held 1.567s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:14 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.info" returned: 0 in 0.244s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:14 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.988s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:14 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-dc3a4cd2-b7de-4447-9bd9-02383da8f717 tempest-SnapshotDependencyTests-251648163 None] Create snapshot completed successfully Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c" acquired by "delete_volume" :: waited 0.014s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[47406424-97a4-472d-a649-b9d818d586f2]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:15 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c Jul 19 17:53:15 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:15 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c" returned: 0 in 0.376s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:15 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c Jul 19 17:53:15 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:15 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c" returned: 0 in 0.249s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c" released by "delete_volume" :: held 0.678s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Created reservations ['49704099-dfbc-4195-aa7f-03d9e421bef3', 'f885d6ea-aff3-4af4-a02c-ff4cc04702d4', '91b09cef-b0f1-4807-90a4-923ad703bd97', 'dad9ec2c-7de7-47ed-9da4-ac43096df25d'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Flow 'volume_create_manager' (1078d5ae-e516-4b63-8d2f-6c6478cb9f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5866ab-dd57-499d-92ce-a5ad2284fa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5866ab-dd57-499d-92ce-a5ad2284fa47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a129ce71be3c4c5d955fb723947f6900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b5e3a860-b613-434b-a52a-6efee02d77c4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:53:16Z,use_quota=True,user_id='c1810ed050c048039e1d924ec39adca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9c4c1a-cace-4ccd-a63e-1a625f81b51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9c4c1a-cace-4ccd-a63e-1a625f81b51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf5bb82-b292-4f6d-800c-2f8fec6c6234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf5bb82-b292-4f6d-800c-2f8fec6c6234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b', 'volume_name': 'volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b', 'volume_size': 1, 'snapshot_id': 'b5e3a860-b613-434b-a52a-6efee02d77c4'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fcf556-baf6-492c-9f74-0817da9fe124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fcf556-baf6-492c-9f74-0817da9fe124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6963b2-cc20-4f64-9787-c362f1910acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:15 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Volume 1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b', 'volume_size': 1, 'snapshot_id': 'b5e3a860-b613-434b-a52a-6efee02d77c4'} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:15 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "cinder-quobyte-b5e3a860-b613-434b-a52a-6efee02d77c4-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b" by "_create_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-quobyte-b5e3a860-b613-434b-a52a-6efee02d77c4-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Creating volume 1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b from snapshot b5e3a860-b613-434b-a52a-6efee02d77c4 {{(pid=87676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "cinder-quobyte-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b" by "_copy_volume_from_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-quobyte-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] snapshot: b5e3a860-b613-434b-a52a-6efee02d77c4, volume: 1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b, {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:16 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:53:16 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd70e06-b758-4959-96eb-762a0f6d3e31]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:16 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 Jul 19 17:53:16 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:16 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.259s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:53:16 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Deleted volume successfully. Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-f9a396ab-8a3a-4877-bbdf-e90cb5c47d86 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-0ce33d12-7ee3-40e0-9813-f0cd9a253b4c-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:16 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4" returned: 0 in 0.424s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3254711f-c007-44dc-8000-3182cdcba4c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] will copy from snapshot at /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Creating direct copy from snapshot {{(pid=87676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d334b2f-5f4b-496a-8198-038e3cf188dd]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:16 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 Jul 19 17:53:16 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (bd411b12-d671-455f-af1e-86ca654ebb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f749fe4-98c0-4dfd-bc41-67be7fc7c8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f749fe4-98c0-4dfd-bc41-67be7fc7c8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2048613850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ca5d08-af60-415c-8082-6caea6704af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:53:17Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e74a9c-cfb7-4d06-9c76-4c1f202cad75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e74a9c-cfb7-4d06-9c76-4c1f202cad75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e360aa-091d-4cdb-849a-c0e637d5ad56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e360aa-091d-4cdb-849a-c0e637d5ad56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6ca5d08-af60-415c-8082-6caea6704af2', 'volume_name': 'volume-b6ca5d08-af60-415c-8082-6caea6704af2', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1567d7f-e376-43a1-b3cd-0ad12ba2e262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1567d7f-e376-43a1-b3cd-0ad12ba2e262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db1a1b8-3d60-4635-89b1-b0b6e20cc075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:16 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Volume b6ca5d08-af60-415c-8082-6caea6704af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6ca5d08-af60-415c-8082-6caea6704af2', 'volume_size': 1} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:16 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1" returned: 0 in 0.357s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG cinder.utils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Path /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b not found in is_blk_device check {{(pid=87676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 19 17:53:16 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:16 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b Jul 19 17:53:16 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:21 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b" returned: 0 in 4.259s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa88a1ea-30dd-4158-84cf-d78a79f4ffc0]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:21 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 Jul 19 17:53:21 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:21 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1" returned: 0 in 0.522s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG cinder.image.image_utils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Image conversion details: src /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1, size 1024.00 MB, duration 4.26 sec, destination /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b {{(pid=87676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 19 17:53:21 devstack cinder-volume[87676]: INFO cinder.image.image_utils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Converted 1024.00 MB image at 240.35 MB/s Jul 19 17:53:21 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b is being set with open permissions: ugo+rw Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:21 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b Jul 19 17:53:21 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:21 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b" returned: 0 in 0.244s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-quobyte-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b" released by "_copy_volume_from_snapshot" :: held 5.933s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-quobyte-b5e3a860-b613-434b-a52a-6efee02d77c4-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b" released by "_create_volume_from_snapshot" :: held 5.963s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.985s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.209s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2048613850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ca5d08-af60-415c-8082-6caea6704af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:53:17Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Creating volume b6ca5d08-af60-415c-8082-6caea6704af2 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:53:21 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:53:21 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:22 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2 1073741824 Jul 19 17:53:22 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6963b2-cc20-4f64-9787-c362f1910acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b', 'volume_size': 1, 'snapshot_id': 'b5e3a860-b613-434b-a52a-6efee02d77c4'}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e470689d-5956-4249-957f-4bf54a50aa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:22 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Volume volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b (1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b): created successfully Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e470689d-5956-4249-957f-4bf54a50aa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Flow 'volume_create_manager' (1078d5ae-e516-4b63-8d2f-6c6478cb9f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:53:22 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-683e561b-830b-4d03-9ba7-3295d49dcb6e tempest-SnapshotDependencyTests-251648163 None] Created volume successfully. Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "cinder-b5e3a860-b613-434b-a52a-6efee02d77c4-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:22 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-b5e3a860-b613-434b-a52a-6efee02d77c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "cinder-quobyte-3254711f-c007-44dc-8000-3182cdcba4c1" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2 1073741824" returned: 0 in 0.479s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-quobyte-3254711f-c007-44dc-8000-3182cdcba4c1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "cinder-quobyte-b5e3a860-b613-434b-a52a-6efee02d77c4" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-quobyte-b5e3a860-b613-434b-a52a-6efee02d77c4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Deleting offline snapshot b5e3a860-b613-434b-a52a-6efee02d77c4 of volume 3254711f-c007-44dc-8000-3182cdcba4c1 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] snapshot_file for this snap is: volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e8339-9787-4c01-8f62-0731b14863c7]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:22 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2 Jul 19 17:53:22 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:22 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 Jul 19 17:53:22 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:22 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2" returned: 0 in 0.249s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db1a1b8-3d60-4635-89b1-b0b6e20cc075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6ca5d08-af60-415c-8082-6caea6704af2', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34aa92d9-a9d0-496d-97d3-ccd3cd3c9cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:22 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Volume volume-b6ca5d08-af60-415c-8082-6caea6704af2 (b6ca5d08-af60-415c-8082-6caea6704af2): created successfully Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34aa92d9-a9d0-496d-97d3-ccd3cd3c9cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (bd411b12-d671-455f-af1e-86ca654ebb2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:53:22 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-3dbc6f7d-6e99-427a-b9c4-f59d00115d17 tempest-ProjectMemberTests-1812963129 None] Created volume successfully. Jul 19 17:53:22 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4" returned: 0 in 0.360s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3254711f-c007-44dc-8000-3182cdcba4c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7103e571-ef40-4354-adb6-4a1a29828fb3]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:22 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:23 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 Jul 19 17:53:23 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:23 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1" returned: 0 in 0.379s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:23 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 Jul 19 17:53:23 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:23 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] Creating offline snapshot db8329fe-26d4-4898-aa5f-ca1615671b77 of volume b6ca5d08-af60-415c-8082-6caea6704af2 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:53:23 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f340ab-7989-454a-9cf1-d5c7988224e0]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:23 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2 Jul 19 17:53:23 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:23 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4" returned: 0 in 0.358s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:23 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4 Jul 19 17:53:23 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:23 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2" returned: 0 in 0.369s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:23 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77 1G Jul 19 17:53:23 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:23 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:23 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1.b5e3a860-b613-434b-a52a-6efee02d77c4" returned: 0 in 0.263s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-quobyte-b5e3a860-b613-434b-a52a-6efee02d77c4" released by "_delete_snapshot" :: held 1.455s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:23 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-quobyte-3254711f-c007-44dc-8000-3182cdcba4c1" released by "delete_snapshot" :: held 1.481s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:24 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Created reservations ['c7d7a89b-da8f-4072-bbc6-60664ace9749', 'c83567e6-3893-44ff-9962-0cf4d417c0e4', '4c8722bf-977c-425c-8f0e-e5a60077f23f', 'd460cb04-79ce-4fc2-95e0-b03246964f81'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:53:24 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Delete snapshot completed successfully. Jul 19 17:53:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-e9bc5610-2a08-4359-8d37-2a9cd46a7e89 tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-b5e3a860-b613-434b-a52a-6efee02d77c4-delete_snapshot" released by "delete_snapshot" :: held 1.629s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:24 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77 1G" returned: 0 in 0.415s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ca5d08-af60-415c-8082-6caea6704af2 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:24 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ca5d08-af60-415c-8082-6caea6704af2 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77 Jul 19 17:53:24 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "cinder-3254711f-c007-44dc-8000-3182cdcba4c1-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:24 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ca5d08-af60-415c-8082-6caea6704af2 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77" returned: 0 in 0.325s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:24 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77 is being set with open permissions: ugo+rw Jul 19 17:53:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-3254711f-c007-44dc-8000-3182cdcba4c1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:24 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77 Jul 19 17:53:24 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "cinder-quobyte-3254711f-c007-44dc-8000-3182cdcba4c1" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:24 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-quobyte-3254711f-c007-44dc-8000-3182cdcba4c1" acquired by "delete_volume" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:24 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ac3617-7bbe-4761-8de0-59a86d86db2b]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:24 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 Jul 19 17:53:24 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:24 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77" returned: 0 in 0.270s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:24 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:24 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.info Jul 19 17:53:24 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:25 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1" returned: 0 in 0.383s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:25 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1 Jul 19 17:53:25 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:25 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.info" returned: 0 in 0.266s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:25 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.info is being set with open permissions: ugo+rw Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:25 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.info Jul 19 17:53:25 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:25 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-3254711f-c007-44dc-8000-3182cdcba4c1" returned: 0 in 0.265s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-quobyte-3254711f-c007-44dc-8000-3182cdcba4c1" released by "delete_volume" :: held 0.706s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:25 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.info" returned: 0 in 0.264s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.993s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Created reservations ['b2a10dd3-4ae7-4d1a-bf8d-3b562c7277a8', 'f284b884-f013-4d90-8e90-ec1d2cc1ab6e', 'e836d25f-8796-4be4-b75b-e3622b1c730f', '01e4ad04-d0fa-44f7-a49f-645748f4c133'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:53:25 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-526d71d8-355b-415d-b518-46dabff8ea48 tempest-ProjectMemberTests-1812963129 None] Create snapshot completed successfully Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:25 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:53:25 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "cinder-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:25 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.302s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "cinder-quobyte-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:25 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Deleted volume successfully. Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-quobyte-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b" acquired by "delete_volume" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-cbc5ab33-8d67-4d92-825f-173e8263a4a8 tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-3254711f-c007-44dc-8000-3182cdcba4c1-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ac3ae0-7df2-4a24-bd78-f37b79015d52]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:25 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:26 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b Jul 19 17:53:26 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:26 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b" returned: 0 in 0.397s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:26 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b Jul 19 17:53:26 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:26 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b" returned: 0 in 0.274s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-quobyte-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b" released by "delete_volume" :: held 0.721s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-db8329fe-26d4-4898-aa5f-ca1615671b77-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Created reservations ['866ce1a5-9364-4518-a01a-f1284a272863', 'ea5689e1-8bcd-4329-8c9d-0a86288fdec7', 'f822e570-5c28-4e70-a2ec-2239c3f44527', 'c670cc2f-7111-446a-bfa2-6ba0cfcc6ce4'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Lock "cinder-db8329fe-26d4-4898-aa5f-ca1615671b77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-b6ca5d08-af60-415c-8082-6caea6704af2" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-b6ca5d08-af60-415c-8082-6caea6704af2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-db8329fe-26d4-4898-aa5f-ca1615671b77" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-db8329fe-26d4-4898-aa5f-ca1615671b77" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Deleting offline snapshot db8329fe-26d4-4898-aa5f-ca1615671b77 of volume b6ca5d08-af60-415c-8082-6caea6704af2 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] snapshot_file for this snap is: volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff237c9d-a415-4599-b228-359498482c5a]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:26 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:26 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:53:26 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:26 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77 Jul 19 17:53:26 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:27 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.279s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:27 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:53:27 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Deleted volume successfully. Jul 19 17:53:27 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77" returned: 0 in 0.408s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:27 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6ca5d08-af60-415c-8082-6caea6704af2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:53:27 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acfe21c-f4a9-402d-b148-f006a866c2c9]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:27 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-01307bd5-8413-4dc4-84e7-023ea7e0298e tempest-SnapshotDependencyTests-251648163 None] Lock "cinder-1eaf92c5-2dbf-4cdc-b59c-98a0d929fb9b-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:27 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2 Jul 19 17:53:27 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:27 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2" returned: 0 in 0.397s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:27 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:27 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77 Jul 19 17:53:27 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:28 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77" returned: 0 in 0.400s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:28 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77 Jul 19 17:53:28 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:28 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:28 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2.db8329fe-26d4-4898-aa5f-ca1615671b77" returned: 0 in 0.263s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-db8329fe-26d4-4898-aa5f-ca1615671b77" released by "_delete_snapshot" :: held 1.576s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-b6ca5d08-af60-415c-8082-6caea6704af2" released by "delete_snapshot" :: held 1.602s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:28 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Created reservations ['34a524fd-546c-4d21-817b-5411e708873b', 'e2057c6d-89fb-4b2a-bf6b-bca10cd08999', '454195dc-8af1-4aad-8716-db76ab6c7241', '552b9b01-bb1e-4b29-8720-48405c05ddc1'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:53:28 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Delete snapshot completed successfully. Jul 19 17:53:28 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-361d7539-9c3e-451a-b5b0-d75f28241a7d tempest-ProjectMemberTests-1812963129 None] Lock "cinder-db8329fe-26d4-4898-aa5f-ca1615671b77-delete_snapshot" released by "delete_snapshot" :: held 2.210s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-b6ca5d08-af60-415c-8082-6caea6704af2-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-b6ca5d08-af60-415c-8082-6caea6704af2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-b6ca5d08-af60-415c-8082-6caea6704af2" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-b6ca5d08-af60-415c-8082-6caea6704af2" acquired by "delete_volume" :: waited 0.014s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:30 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2029d69-38a9-4599-9dfa-be467531f0d0]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:30 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2 Jul 19 17:53:30 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:30 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2" returned: 0 in 0.372s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:30 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2 Jul 19 17:53:30 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:30 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:30 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-b6ca5d08-af60-415c-8082-6caea6704af2" returned: 0 in 0.247s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:30 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-b6ca5d08-af60-415c-8082-6caea6704af2" released by "delete_volume" :: held 0.681s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:32 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Created reservations ['0e0fdf67-adc2-45a2-8f79-5647f9d4780f', 'eff6aaf8-ee04-4fcd-acc5-ba12d8d29ca4', 'f29eb3a2-fcbd-410f-8d8d-b3e75104067a', '29263b2d-59fa-4bbd-b13c-950a0e232115'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:53:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:53:32 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:53:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:32 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:53:32 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:32 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:32 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.279s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:32 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:53:32 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Deleted volume successfully. Jul 19 17:53:32 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-114b6053-87ab-4699-ae65-44bbf7cb5a64 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-b6ca5d08-af60-415c-8082-6caea6704af2-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:33 devstack cinder-volume[87676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 19 17:53:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (5b1e5311-1889-42f3-b044-3e30434eba01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:53:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0c8f95-a1d8-47d3-9be8-58b79dcc87e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0c8f95-a1d8-47d3-9be8-58b79dcc87e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-432135842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c68e15d-1a03-4408-8fb4-25f89c9dd586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:53:34Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9828144d-8ee2-43c0-8048-d7cc2f490023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9828144d-8ee2-43c0-8048-d7cc2f490023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851e2078-9f45-4273-a844-ef172a3a2f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851e2078-9f45-4273-a844-ef172a3a2f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c68e15d-1a03-4408-8fb4-25f89c9dd586', 'volume_name': 'volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb40f6b3-7fcc-4f63-807a-01e75fd94957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb40f6b3-7fcc-4f63-807a-01e75fd94957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:33 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90b3d97-ea75-472b-bbe8-4635a8e4d9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:33 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Volume 4c68e15d-1a03-4408-8fb4-25f89c9dd586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586', 'volume_size': 1} Jul 19 17:53:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:33 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:33 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-19T15:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-432135842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c68e15d-1a03-4408-8fb4-25f89c9dd586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781285157352417abafc645a938a8e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T15:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T15:53:34Z,use_quota=True,user_id='713cd4ba31a9435c9b228de3d221b345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2),volume_type_id=1e6b2c68-41f6-4320-9f3b-c9672bc2c0d2)}" {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Creating volume 4c68e15d-1a03-4408-8fb4-25f89c9dd586 {{(pid=87676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Selected osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c as target Quobyte volume. {{(pid=87676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 19 17:53:34 devstack cinder-volume[87676]: INFO cinder.volume.drivers.remotefs [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] casted to osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 1073741824 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:34 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 1073741824 Jul 19 17:53:34 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:34 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 1073741824" returned: 0 in 0.466s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:34 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 Jul 19 17:53:34 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:34 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586" returned: 0 in 0.283s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'} {{(pid=87676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90b3d97-ea75-472b-bbe8-4635a8e4d9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586', 'volume_size': 1}' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db673d52-5f08-4a37-b61a-e89603555816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 19 17:53:34 devstack cinder-volume[87676]: INFO cinder.volume.flows.manager.create_volume [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Volume volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 (4c68e15d-1a03-4408-8fb4-25f89c9dd586): created successfully Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db673d52-5f08-4a37-b61a-e89603555816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Flow 'volume_create_manager' (5b1e5311-1889-42f3-b044-3e30434eba01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 19 17:53:34 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b1c15869-4be2-4adb-93f9-cafa771929a5 tempest-ProjectMemberTests-1812963129 None] Created volume successfully. Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:34 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:34 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:53:35 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:35 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:35 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.280s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:35 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:53:35 devstack cinder-volume[87676]: DEBUG oslo_service.periodic_task [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] Running periodic task VolumeManager._thread_info {{(pid=87676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 19 17:53:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread count: 29 {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 19 17:53:35 devstack cinder-volume[87676]: DEBUG cinder.volume.manager [None req-e4456845-39a8-4d6d-b8cb-fe990d58074a None None] thread info: [<_MainThread(MainThread, started 135951472103552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 19 17:53:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:36 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] Creating offline snapshot 904f4921-4544-492e-8b59-7696115a7288 of volume 4c68e15d-1a03-4408-8fb4-25f89c9dd586 {{(pid=87676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 19 17:53:36 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecc667b-ccdc-49ee-93d0-715b8bbdb88c]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:36 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 Jul 19 17:53:36 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:36 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586" returned: 0 in 0.450s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:36 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288 1G {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:36 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288 1G Jul 19 17:53:36 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:37 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288 1G" returned: 0 in 0.431s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:37 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288 Jul 19 17:53:37 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:37 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 -F qcow2 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288" returned: 0 in 0.349s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:37 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288 is being set with open permissions: ugo+rw Jul 19 17:53:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:37 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288 Jul 19 17:53:37 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:37 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288" returned: 0 in 0.262s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:37 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:37 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.info Jul 19 17:53:37 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:38 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.info" returned: 0 in 0.284s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:38 devstack cinder-volume[87676]: WARNING cinder.volume.drivers.remotefs [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.info is being set with open permissions: ugo+rw Jul 19 17:53:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.info {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:38 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.info Jul 19 17:53:38 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:38 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.info" returned: 0 in 0.274s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:38 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.135s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:38 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-00aabad2-12a4-45c6-a53d-a3580ea259af tempest-ProjectMemberTests-1812963129 None] Create snapshot completed successfully Jul 19 17:53:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-904f4921-4544-492e-8b59-7696115a7288-delete_snapshot" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-904f4921-4544-492e-8b59-7696115a7288-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-4c68e15d-1a03-4408-8fb4-25f89c9dd586" by "delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-4c68e15d-1a03-4408-8fb4-25f89c9dd586" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-904f4921-4544-492e-8b59-7696115a7288" by "_delete_snapshot" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:39 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-904f4921-4544-492e-8b59-7696115a7288" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Deleting offline snapshot 904f4921-4544-492e-8b59-7696115a7288 of volume 4c68e15d-1a03-4408-8fb4-25f89c9dd586 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 19 17:53:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] snapshot_file for this snap is: volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288 {{(pid=87676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 19 17:53:39 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb290bd-39fa-4d14-b514-842f956d89a9]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:39 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288 Jul 19 17:53:39 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:39 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288" returned: 0 in 0.375s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:39 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.remotefs [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 19 17:53:39 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0239fd33-8e06-482c-be71-ed4c776eadff]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:39 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:40 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 Jul 19 17:53:40 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:40 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586" returned: 0 in 0.364s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:40 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288 Jul 19 17:53:40 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:40 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288" returned: 0 in 0.342s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:40 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288 Jul 19 17:53:40 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:40 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:40 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586.904f4921-4544-492e-8b59-7696115a7288" returned: 0 in 0.251s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-904f4921-4544-492e-8b59-7696115a7288" released by "_delete_snapshot" :: held 1.421s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:40 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-4c68e15d-1a03-4408-8fb4-25f89c9dd586" released by "delete_snapshot" :: held 1.445s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:41 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Created reservations ['85ba8b16-15e4-4c4f-8c30-1299ce414a3c', '0a4562b6-78cd-4c06-ac61-47c87bf37037', 'b539cfa8-4140-44ec-af02-78faa2fbbbf6', 'ab94bb34-932c-41f4-b13b-e4b660616e16'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:53:41 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Delete snapshot completed successfully. Jul 19 17:53:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-b86f8b01-9f5d-43c4-877a-5856cdfab075 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-904f4921-4544-492e-8b59-7696115a7288-delete_snapshot" released by "delete_snapshot" :: held 1.571s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-4c68e15d-1a03-4408-8fb4-25f89c9dd586-delete_volume" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-4c68e15d-1a03-4408-8fb4-25f89c9dd586-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "cinder-quobyte-4c68e15d-1a03-4408-8fb4-25f89c9dd586" by "delete_volume" {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 19 17:53:41 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-4c68e15d-1a03-4408-8fb4-25f89c9dd586" acquired by "delete_volume" :: waited 0.014s {{(pid=87676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 19 17:53:41 devstack cinder-volume[87676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fca5817-2fa0-484e-89a7-2556ce2e11ed]: (4, 'qcow2') {{(pid=89278) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 19 17:53:41 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:41 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 Jul 19 17:53:41 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:42 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586" returned: 0 in 0.352s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:42 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586 Jul 19 17:53:42 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:42 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1/volume-4c68e15d-1a03-4408-8fb4-25f89c9dd586" returned: 0 in 0.244s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-quobyte-4c68e15d-1a03-4408-8fb4-25f89c9dd586" released by "delete_volume" :: held 0.657s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:42 devstack cinder-volume[87676]: DEBUG cinder.quota [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Created reservations ['40845497-0b73-4d9f-8d79-a0f3fbd93d49', 'fd82a26d-8fc0-43a9-a4b1-e0242a246653', '75e4da65-9af2-455d-8cd4-91e130d949ff', 'a1a42729-668d-486f-a4d6-771ab158107c'] {{(pid=87676) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 19 17:53:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 19 17:53:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 19 17:53:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c': None} {{(pid=87676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 19 17:53:42 devstack cinder-volume[87676]: DEBUG cinder.volume.drivers.quobyte [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bbe78e69-1978-409c-bd7f-2bec884e866c'] {{(pid=87676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 19 17:53:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.lockutils [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 19 17:53:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 19 17:53:42 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1 Jul 19 17:53:42 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 19 17:53:42 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 19 17:53:42 devstack cinder-volume[87676]: DEBUG oslo_concurrency.processutils [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/83da4bfce05f5fff54e30cacc5e483c1" returned: 0 in 0.255s {{(pid=87676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 19 17:53:42 devstack cinder-volume[87676]: DEBUG cinder.manager [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Notifying Schedulers of capabilities ... {{(pid=87676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 19 17:53:42 devstack cinder-volume[87676]: INFO cinder.volume.manager [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Deleted volume successfully. Jul 19 17:53:42 devstack cinder-volume[87676]: DEBUG cinder.coordination [None req-5a855299-3458-4461-8e5d-cdd3d798d013 tempest-ProjectMemberTests-1812963129 None] Lock "cinder-4c68e15d-1a03-4408-8fb4-25f89c9dd586-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87676) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 19 17:53:52 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=65,cinder:INSERT=23,cinder:UPDATE=68,cinder:DELETE=6 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 19 17:53:52 devstack cinder-volume[87676]: DEBUG dbcounter [-] [87676] Writing DB stats cinder:SELECT=50,cinder:UPDATE=80,cinder:INSERT=18,cinder:DELETE=5 {{(pid=87676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}